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ABSTRACT 
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interest.  Hostile  R  (Red)  vessels  enter  the  domain.  The  Rs  are  traveling  through  the 
domain  toward  targets.  Overhead,  friendly  (Blue)  sensors  ( S)  patrol  the  domain  and 

classify  (perhaps  incorrectly)  detected  vessels  of  interest  as  R  or  W.  The  misclassification 
of  a  W  as  an  R  is  a  false  positive.  An  overhead  sensor  follows  (or  tracks)  any  vessel  it 
classifies  as  R  until  it  is  relieved  by  another  platfonn,  perhaps  a  destroyer  pair  (DD).  The 
overhead  sensor  is  here  assumed  unable  to  detect  and  classify  additional  vessels  while  it 
is  following  a  suspicious  vessel;  this  may  well  be  a  somewhat  pessimistic  assumption, 
very  possibly  “richer  possibilities”  based  on  additional  assets  (such  as  unmanned  aerial 
vehicles  (UAVs))  are  available,  but  loss  of  track  may  occur  as  well  as  misclassification. 

Detenninistic  and  stochastic  models  are  formulated  and  studied  to  evaluate  the 
probability  that  Rs  are  successfully  neutralized  before  reaching  their  destination.  The 
model  results  quantify  the  effect  of  the  resources  and  time  needed  to  prosecute 
misclassified  Ws  (false  positives)  on  the  probability  of  successfully  neutralizing  R. 

The  results  indicate  that  the  probability  of  neutralizing  an  R  vessel  is  very  sensitive 
to  the  false  positive  rate.  Technologies,  processes,  and  procedures  that  can  decrease  the 
false  positive  rate  will  increase  the  effectiveness  of  the  Maritime  Intercept  Operation 
(MIO). 
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0.  Background 

The  general  tenn  Maritime  Domain  Awareness  (MDA)  includes  a  broad  range  of 
initiatives  to  enhance  both  the  security  of  ports  and  approaches  to  the  United  States  and 
the  force  protection  of  U.S.  and/or  allied  maritime  assets  (e.g.,  Japan,  Singapore,  Bahrain, 
etc.)  in  ports  and  choke  points  throughout  the  world.  An  essential  requirement  is  to 
furnish  adequate  Blue  surveillance  force  size  and  composition,  and  resource-assignment- 
effective  CONOPS  to  maintain  useful  knowledge  of  hostile  (Red)  elements. 

We  consider  the  following  scenario.  Hostile  Red  vessels  (Rs)  enter  a  domain  or 
region.  The  Rs  are  transiting  through  the  region  toward  targets.  There  are  Blue  overhead 
sensors  that  patrol  the  domain.  Blue  wishes  to  neutralize  the  Rs  before  they  reach  their 
targets.  In  addition  to  the  Rs,  there  are  neutral  White  (W)  vessels  of  interest  in  the  region 
that  can  be  misclassified  as  Rs.  A  sensor  system  classifies  vessels  of  interest  as  W  or  R.  If 
the  sensor  misclassifies  a  W  as  an  R,  a  false  positive  occurs.  The  sensor  follows  (tracks) 
any  vessel  classified  as  an  R  until  it  is  relieved  by  another  platfonn.  During  this  following 
time,  the  sensor  is  unable  to  classify  any  further  vessels.  The  probability  of  neutralizing 
an  R  depends  on  the  area  of  the  domain  being  patrolled,  the  number  of  sensors,  the 
velocity  of  the  sensors,  the  time  needed  to  classify  a  vessel  of  interest,  the  ability  to 
correctly  classify  vessels  of  interest,  the  time  until  a  sensor  following  a  suspicious  vessel 
is  relieved,  and  the  false  positive  rate.  The  false  positive  rate  is  a  function  of  the 
probability  of  correct  classification,  which  may  well  be  environmentally  dependent  (see 
Frederickson  and  Davidson  (2003))  and  the  number  of  vessels  of  interest  that  are  Ws. 

We  present  five  models  to  study  Blue  force  size  requirements  in  this  scenario.  The 
results  of  the  models  highlight  the  importance  of  minimizing  the  false  positive  rate;  a 
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false  positive  occurs  when  a  friendly  (White)  vessel  is  misclassificd  as  hostile  (Red)  and 
increases  as  the  number  of  friendly  (White)  vessels  that  are  subject  to  surveillance  and 
possible  classification  as  hostile  (Red)  increases. 

Section  1  presents  a  detenninistic  model,  a  so-called  “fluid  approximation”  model, 
consisting  of  a  system  of  differential  equations.  Models  2,  3,  4,  and  5  are  stochastic 
models.  All  of  these  provide  insights,  but  are  also  useful  to  help  validate  and  verify  more 
complex  simulations.  Sections  2  and  3  present  Markovian  stochastic  models.  Section  4 
presents  examples  comparing  the  results  of  the  Deterministic  and  Markovian  models.  The 
sensitivity  of  the  ability  to  neutralize  Rs  to  model  parameters,  such  as  the  size  of  the 
domain,  the  speed  of  the  sensor,  the  ability  to  correctly  classify  the  vessel  type,  and  the 
rate  of  false  positives,  is  also  discussed  in  Section  4.  Section  5  presents  a  non-Markovian 
model  and  approximations  for  the  probability  that  R  is  neutralized.  The  usefulness  of  the 
approximations  is  studied  by  comparing  their  results  to  those  obtained  from  more  detailed 
Monte  Carlo  simulations.  The  approximations  give  very  reasonable  results.  Numerical 
results  using  the  approximations  are  presented  to  illustrate  the  evaluation  of  the  number 
of  overhead  sensors  that  are  needed  to  patrol  a  domain  to  achieve  a  probability  of 
neutralizing  an  R  larger  than  a  specified  value. 

One  technology  that  is  being  proposed  to  reduce  the  false  positive  rate  is  to  use  the 
Automatic  Identification  System  (AIS)  to  classify  and  track  vessels  in  the  maritime 
domain.  In  Section  6,  a  stochastic  model  is  presented  for  the  ability  to  detect  and  classify 
vessels  in  the  maritime  domain  using  AIS;  in  particular,  the  model  is  used  to  obtain  an 
expression  for  the  probability  that  a  vessel  with  AIS  will  not  be  detected  by  an  overhead 
surveillance  system  that  is  periodically  over  the  maritime  domain;  the  vessel  will  not  be 
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detected  if  all  of  its  AIS  messages  are  blocked  during  one  pass  of  the  overhead 
surveillance  system. 
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1.  Model  1:  A  First  Deterministic  “Fluid”  Model 


1.1.  Formulation 

An  Area  of  Interest  (Aol),  the  Domain,  V  for  short,  is  entered  via  an  upper 

boundary,^  ,  by  both  Ws  and  Rs.  The  Rs  aim  to  transit  to  the  lower  boundary  A*  ,  cross 
it,  and  enter  Blue  Homeland  (iP(/f))  in  order  to  damage/destroy  infrastructure  and 
population.  The  Ws  transit  within  and  through  the  Domain,  V,  with  no  hostile  intent. 

They  may  be  ferries,  fishing,  and  other  pleasure  boats,  or  innocuous 
cargo-carrying  vessels. 

To  protect  V  is  under  surveillance  by  a  force  of  S  surveillance  platforms 

(denoted  by  S)  such  as  helicopters  (helos),  UAVs,  and  fixed  wing  (FW)  aircraft 
(e.g.,  P3s);  this  is  the  Overhead  Force  (OH);  their  purpose  is  to  detect  and  (correctly) 
identify  Reds/Hostiles  in  transit  from  V  to  V  and  prevent  them  from  penetrating  V  to 
reach  Note  that,  in  the  present  simplified  model,  when  the  number  of  Ws 

(respectively  Rs)  equal  w  (respectively  r  for  Rs),  the  Ss  act  independently,  coming  at 
random  with  rate  8{w+r) ,  on  potential  targets  for  escort  off-'D  by  armed  and  lethal  Blue 

(B)  vessels  (e.g.,  destroyers  (DDs)),  but  may  do  so  erroneously:  a  W  may,  for  instance, 
be  misidentified  as  an  R  and  followed  by  a  previously  free  S  until  DD  escorts  appear  to 
take  it  to  a  segregated  Pound/Quarantine  (PQ)  area.  If  the  followed  vessel  is  indeed  an  R, 
then  the  flow  of  Rs  through  V  is  lessened,  to  the  advantage  of  B;  but,  if  it  turns  out  to 

actually  be  W,  then  the  S  force  is  temporarily  reduced,  to  the  clear  disadvantage  of  Blue. 
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Assume  that  the  mean  time  that  an  S  requires  to  service/follow-to-escort  a  detected  and 
classified-as-R  vessel  (could  actually  be  W  or  R)  is  1/^.  Note:  We  do  not  here  consider 
that  the  escort  fleet  (DD  numbers)  may  be  limited. 

We  now  propose  a  simple  deterministic/“fluid  approximation”  model  to  describe  the 
state  of  the  system,  i.e.,  the  numbers  of  free  and  followed  (misidentified)  Ws  and  Rs  in  V 

at  time  t  after  some  initial  instant.  We  assume  that  once  a  W  is  classified  as  an  R  it  is 
followed  (tracked)  and  removed  from  further  consideration;  a  sensor  that  is  following  a 
vessel  classified  as  an  R,  while  awaiting  the  surface  escort  vessel  (e.g.,  DDs),  is  unable  to 
search  for  Rs. 

Objective  (Principle).  Characterize/model  to  reveal  the  rate  of  leakage  of  hostile  Rs 
through  V  as  it  depends  on  the  magnitude  of  S  and  various  operational  parameters.  Let 

leakage  be  defined  as 

•  L(^S\V,  parameters  and  CONOPS)  =  rate  at  which  Rs  cross  the  Homeland  Boundary  V 
The  mean  time  a  free  R  spends  in  I?  is  1  ///,.;  the  mean  time  a  followed  R  (number  is 

Rf(t)  at  t )  spends  in  V  is  1///* ;  in  more  detailed  models,  the  R  may  evade  or  dash  to  a 

boundary  if  detected,  but  such  a  move  may  well  be  to  his  disadvantage.  In  the  simplest 
case,  the  leakage  rate  at  time  t  is 

•  Z(t)  =  jurR(t)  +  jurRf{t),  orZ(<x>)  =  //r  lim  +  //;.  lim  Rs  (t)  =  jurr  + /Jriy  . 

J  <—>00  <->oo  J  J 

This  assumes  that  there  is  a  finite  long-run  steady  state  value  of  both  R(t )  and  Rf  (i) , 
which  follows  if  the  (leakage)  rates,  //,.  and  //*  are  both  positive. 
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1.2.  Initial  Fluid  Model 


Let 


W  (?)  =number  of  free,  undetected  and  unfollowed  Ws  in  V  at  time  t; 

Wf(t)=  same,  but  now  detected  and  followed  until  it  is  induced/directed  to  meet 
an  escort  (e.g.,  DD-pair).  Each  S  so  involved — one  per  fVy ,  is  unprofitably  employed  not 

as  an  active  searcher  capable  of  detecting  a  “true  R”; 

R(t)  =number  of  lethal  Rs  in  V  at  time  t  that  are  undetected  and  unfollowed; 

Rf  (?)=number  of  potentially  lethal  Rs  (to  Blue  (B)  Homeland)  that  have  been 

detected  and  are  being  followed,  in  this  case  profitably. 

Note:  The  number  of  Ss  engaged  in  following,  and  therefore  not  free  to  search/carry 
out  detection  and  (mis)  classification,  is  S{t)  =  Wj-(t)  + Rf{t) ,  provided  (as  assumed) 


there  is  one  S  assigned  to  each  following  operation.  There  is  no  swarming  to  verify 


detection/classification,  although  this  is  an  emerging  alternative. 


1.2.1.  Example  State  Transitions  in  the  First  Fluid  Model 


For  h  >  0  “small”  we  write  (for  example) 


W{t  +  h)  =  W{t)+  Ajfih  -  nwW{t)h 

W  arrivals  in  V  W  departures 
during  (t,t+h]  from  T> 

during  (t,t+h] 


-  S  -  Wf{t)- Rf{t)X  d(W{t)  +  R{t)) 

'■ - v - J  K  ' 

free-to-search  detection 

OH  force  rate 

elements  when 

W(t)+R(t) 

vessels 


R[t) Cwr^  +  ’ 

Prob. 
detect 
Free  W 


in© 


(1.2.1) 


where  cwr  is  the  probability  that  a  W  is  misclassified  as  an  R. 
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Note  that  8 (7)  is  the  overall  search  rate;  rate  of  contact  between  Free  Ss  and  Free  Ws; 


the  rate  of  detection  depends  on  the  size  of  V  and  the  number  of  Ws  and  Rs  in  V;  the 


expression  above,  with  the  tenn  [  ]+  expresses  explicitly  the  fact  that  Wj-  (t)  +  Rf  (t)  <  S  ; 


the  probability  cwr  is  that  of  mistaking  a  W  for  an  R  and  thus  initiating  a 
counterproductive  “follow.” 

Manipulation  of  (1.2.1)  (subtraction  of  W(t) ,  division  by  h,  letting  h  -»  0)  yields  the 


differential  equation 


(1.2.2) 


An  analogous  argument  leads  to 


follow  of  Ws  as  (mistakenly)  Rs 
initiated 


follow  ends  with  follow  ends  by 
meeting  DD  followed  vessel 

escort  leaving 

domain 


(1.2.3) 


Likewise  and  analogously  for  Rs: 

(1.2.4) 
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and 


d^=[s-M‘)-RA<)]'  s(w(‘) 

follow  of  R  legitimately 
and  correctly 
by  S 

VrRf{*) 

follow  ends  by 
followed  vessel 
leaving 
domain 


-  ~ 

follow  ends  with 
meeting  DD 
escort 


(1.2.5) 


1.3.  Steady-State  or  Long-Run  (t  -+<x>)  Equations  for  the  Simple  Fluid  Model 

Assume  Aw{t)  =  Aw,Ar(t)  =  Ar.  Then  W(t)->W(oo')  =  w,R(t)->R(oo')^r,etc.;  the 

dR 

values  are  obtained  by  setting  —  =  0 ,  etc.  in  ( 1 ,2.2)-(  1 .2.5). 


0  =  kw-Hww-  S-Wy-ry  S(w  +  r)c 


w 


w+r 


~  ”  +  ,  W  5i« 

0=  S  —  wf  —rf  8{w  +  r )cwr - wf</>w  -  jUwwf 

<-  J  J  -i  w+r  •  •  -  • 


follow  of  W  as  R 


follow  follow  ends  by 
ends  followed  vessel 

with  leaving 

meeting  domain 
DD 
escort 


(1.3.1) 

(1.3.2) 


0 -Ay.-Hy.r-  S—Wf—rj  5(w+r^c 


w  +  r 


(1.3.3) 


0=  S-wy-ry  8{w+r}c 


w  +  r 


follow  of  R  as  R 


rA 

-  /vy 

‘ - V - • 

' - V - • 

follow 

follow  ends  by 

ends 

followed  vessel 

with 

leaving 

meeting 

DD 

escort 

domain 

(1.3.4) 
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A  Special  Case 


Wf+Tf 

Let  p  =  _  .  Assume  8  ( w  +  /•)  =  ()0  x  [  w  +  r\,  where  80  is  a  constant;  (f>w  =  </>,. ; 
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/./*,  =  //*  and  wy  +  /y  <  5  .  Then 


w  =  - 


Av 


/A'  S  [i  P\  A)cwr 

(1.3.5) 


w 


f 


S{\-  p)SQCwr 

S  (l-  p)Sqcwj. 

A 

*  W  ~ 
<Pw+  Pw 

<t>w  +  Pw 

_ Pw  +  5  (l  -  p) Sq cwr  _ 

r  — 


Ar 


Pr  +  5  [l  /?]  8qCit 
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5(l-p)<W 

S{l~p)SQCrr 

Ar 

*  r  ~ 
fir  f^r 

fir  +  ^r 

fly  +  5  (l  —  P ^  SfiCyy 

Since 

wf+rf 


P 


(1.3.6) 


(1.3.7) 


(1.3.8) 


1 

5(1  p^Sqcwj. 

Av 

_l_ 

S(\-p)S0crr 

Ay 

J 

$w  Pw 

Pw  +  S  (l- p)  SqCwi,  _ 

1 

fiy  +  Py 

Py  H"  S  ^  l  —  P  ^  SftCyy 

.(1.3.9) 


Note  that  the  RHS  of  the  equation  (1.3.9)  decreases  as  p  increases.  Thus,  there  is  one 
solution.  For  given  S  and  parameters  one  can  solve  for  p;  p  satisfies 


P 

1  ~  P 


&0cwr 

A 

_1_ 

Afrr 

Ay 

_<t>w  +  Pw  _ 

_  Pw  +  S  (1  -  p)  £>0 cwr  _ 

I 

J>r  +  Pr  _ 

Pr  +5(1  —  p)SqCit 

X 

If  80  -  0 ,  then  the  solution  is  p  =  0 ;  thus  w  =  — 1 11  r  =  — . 

Pw  Pr 


(1.3.10) 
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1.4.  Linearization  of  Dynamic  Equations  ((1.2.2)-(1.2.5))  via  a  Steady-State 
Term  Replacement 

The  analytical  intractability  and  computational  awkwardness  in  solving  the 
time-dependent  equations  (1 .2.2)-(l .2.5)  owes  to  the  tenn  [ that 

appears  in  each.  Assume  S(w+r)  =  So  x(w  +  r).  We  now  investigate  the  effect  of 
substituting  the  corresponding  constant  steady-state  term  for  it,  and  thus  solving  the 
following  linear  equations: 


CmjfL  =  K  -  W  +  S  (1  ■ -  P)SOcwr  )w{t)  (1.4.1) 

^^  =  5(l-p)<%Cwrir(0-(^  +  ^)»>(0  (1-4.2) 

d^l^A,.-(Mr  +  S(l-p)S0cn.)R(t)  (1.4.3) 

d^^  =  S(\-p)S0crrR{t)-^r  +  ^)Rf(t).  (1.4.4) 


The  solutions  to  these  are  elementary.  To  simplify  writing  put 

A  =  juw  +  S(\-p)S0cwr 
B  =  S(\-p)S0cwr 

C  =  <t>w  +  Mw 

D-jUr+S{\-  p)Sqcjt 
E  =  S(l-p)S0crr 
F  =  <j>r  +  pr 
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Start  by  solving  (1.4.1) 


W(t)  =  W(  0)e~At  +^(l-e~At'),  (1.4.6) 

then  substitute  into  (1.4.2): 

(  2  ~\(  0—At_  -Cfh  i  i_  -Ct 

Wf(t)  =  Wf(0)e-c‘  +B  m«)~\  -FZT-  '  (1A7> 

.  'v  y 

Simply  changing  parameter  values  solves  (1.4.3)  and  (1.4.4): 

AM/)-  R(o)e~F‘  i  i|l  e~D‘  )  (1.4.8) 


«f  (')  =  */(»)< 


+  £  [«(0)-i 


—Dt  -Ft  )oi-. 
e  -  e  /(,.  1  -  e 

A-D  D  F 


(1.4.9) 


These  are  all  simple  solutions  involving  exponentials  and  constants.  They  perform 
correctly  at  t  =  0  and  t  =  go  (compare  to  results  (1.3. 5)-(l. 3. 8)). 

These  can  be  compared  to  simulation  results. 

A  fundamental  Measure  of  Effectiveness  (actually  Defectiveness)  is  the  rate  of 
leakage  of  Rs  through  V  .  Note  that  both  R{t )  and  Rf(t)  can  reach  V  before  arrival  of 

DD  escorts,  so  the  total  leakage  over  time  t  is  given  by 

t  t 

L  (t)  —  J + 1  Rj  ( s)jurds  ( 1 .4.10) 

0  0 


and  approximately  by 

t  t 

Z(V)  =  +  Jk’y’  [s^jUj.ds  .  (1.4.1 1) 

0  0 
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In  steady-state  or  long-run,  the  average  rate  of  leakage  is 


/  \  T  (  t  )  Sis 

L  (  go  )  =  lim  — —  =  rjur  +  rfjUr 
t — ^00  t 


(1.4.12) 


1.5.  Generalization  to  More  Awareness  States 


Here  are  some  directions  that  generalizations  and  approximations  with  somewhat 
more  reality  can  take. 

1.5.1.  Time-Consuming  Classification 


Suppose  it  is  acknowledged  that  when  a  free-searching  Blue  surveillance  agent,  an  S, 


detects  a  potential  threat  it  may  spend  a  nonnegligible  time  classifying  it;  let  that  time 
have  mean  r  or  rate  1/r,  and  the  resulting  classification  accuracy  depends  on  that 
(mean)  time:  i.e., 

(a)  cwr  (r)  decreases  with  r; 

(b)  c,T(r)  increases  with  r. 

The  specific  form  of  the  dependence  can  be  established  by  field  experiment,  or  at 
least  cwr  ( aw )  and  cn.  (ar )  can  be  made  plausibly  parametric,  e.g.,  the  logistic  or  Weibull 
with  parameters  (vectors)  aw  and  ar  ,  respectively. 

One  possibility  to  account  for  the  influence  of  a  nonzero  classification  time  is  to  add 
the  means  of  the  detection  times  and  the  classification  times;  then  invert  to  obtain  the 
effective  rate  of  detection  and  classification: 

(1.5.1) 
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A  more  physical  version  of  the  above  is  given  in  Section  (4.1).  In  the  fluid 
approximation  proposed,  with  dynamic  equations  (1 .3. l)-(  1 .3.4)  and  steady-state 


equations  (1.3. 5)-(  1.3. 9)  replace  S0  by  5q(t)  =  \! 


r  1  ' 


) 


and 


C\vr  ^wri^’—w) 

Cyy  by  Cyy  (  T\  0_y  ) 


(1.5.2) 


Apparently,  r  is  a  decision  variable  available  for  adjustment  by  S 
(Blue  Surveillance)  to  minimize  the  rate  at  which  Rs  cross  V  into  .  See  below. 

1.5.2.  A  Parametric  Model  for  the  Probability  of  Correct  Classification  as  a 
Function  of  Classification  Time 

Assume  that  the  probability  of  correct  classification  of  a  vessel  of  type  j  is  a  function 
of  the  time  spent  classifying  the  vessel.  One  functional  form  for  the  conditional 
probability  that  a  vessel  of  type  j  is  correctly  classified  as  type  j  when  r  time  units  are 


spent  classifying  it  is  c7-7(r)  =  0.5 +  0.5  — — - — ;  the  parameter  a,  a  classification  time 

1  +  (/?r)a 

r0,  and  a  target  value  cjj  are  specified;  /?  is  chosen  so  that  Cjj  (r0)  =  cjj  .  More 

rationally,  use  t  to  optimize  an  MOE/MOP:  e.g.,  the  probability  that  the  Red  leaks 
through  V  is  minimized.  See  Section  4.1,  especially  Figures  4.5a,  4.5b,  4.6a,  4.6b,  and 
4.5ad,  4.5bd,  4.6ad,  and  4.6bd,  where  it  is  shown  that  the  qualitative  effect  carries  over 
between  stochastic  and  detenninistic/fluid  models. 

1.6.  A  Partially-Spatial  Detection  (“Strip  Search”)  Model 

Suppose  domain  V  is  divided  spatially  into  i  e  {1,2,3,.../}  strips  ( subdomains )  that 
roughly  parallel  the  shoreline.  Let  Vt  be  the  ith  such  strip,  with  Aj  the  furthest  toward 
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open  sea,  and  A)  the  closest  to  (one  border  being)  the  shoreline/beach.  Any  vessel,  say  a 
hostile  Red,  that  enters  V  must  first  enter  Aj ,  proceed  from  that  to  V2  ,  to  At ,  etc.,  and 
finally  to  V1 .  For  simplicity,  each  subdomain  A>  [i-\, ...,/)  can  be  rectangular;  they 
cover  V  without  overlap. 

The  state  transition  equations  must  be  augmented  as  follows:  Introduce 
Uvi{t),Wfi{t),Ri{t),Rfi[t)-,i  =  l,2,...l\  vector(s)  of  numbers  of  W  and  Runits  occupying 
each  subdomain  A*  i  =  .  Then  differential  equations  can  be  written  that  express 

transitions  into  and  out  of  A>- ,  following  arguments  similar  to  those  leading  to 
(1.2.2)-(1.2.5).  Here  are  some  important  special  cases.  The  parameters,  as  in  Section  1.2, 
are  now  stage  dependent,  including  the  number  of  sensors/level  of  surveillance  associated 
with  A* ;  the  latter  can  change  in  response  to  need  in  a  particular  geographical  stage. 

Case  1.  Ws  enter  at  migrate  to  2k ,...  or  leave  Z\  for  outside,  all  if  uninterrupted 
by  S  and  followed;  Rs  enter  at  A} ,  migrate  to  A2 ,  ...eventually  leak  through  A)  if  not 
intercepted  and  followed  by  S  to  DDs.  Innocuous  Ws  “leak”  downwards  and  sideways, 
whereas  hostile  Rs  leak  purposefully  toward  A)(//),  the  sea-land  Blue  Homeland 
barrier.  The  dynamic  equations  akin  to  (1.2.2)-(1.2.5)  are  now  these: 


dW]  ( t ) 
dt 


=Av(0-/vi(0^i(0 

-[5  -  wfi  (0  -  (Of  WO + *i  (0)<W4  Wi  {l) 


(1.6.1) 


Mf,  i(')_ro 


*  -=P. (162) 

-^7,i(0^w,t  (0 
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(1.6.3) 


dR\  (?) 


-  Ar  (?)  fir  \  (?)^?i  (?) 


{s,  -  »>,!  (o  -  i/4  (<)]+ «,(»,(<)+ w)^.i  ffi(,y]i()) 


■flV.l  (0  =  j-y  y  (  '  _  R  (()]+  S  Iff 1  M  +  R  (|)V  -  R'(‘) 

dt  LI  /4WJ  H  1U  ”’V1(?)  +  i?1(?).  (1.6.4) 

-Rf,  1  (0^,1  ~Vr,\Rf,\  (0 

Next,  for  interstages,  f  =  2,3,...,/;  simply  replace  /Sv  (?)  by  the  arrival  rate  of  Ws  from 
the  previous  stage,  where  0  <  co^  <  1  is  the  fraction  of  platforms  of  type  U  that  “leak”  into 

strip  i  from  strip  /-I  (closer  to  entry  strip  1).  We  do  not  consider  entries  at  the  sides  of  V, 
although  this  could  be  represented. 


dWi{t) 


=  ™w,iVw,i-\Wi-\  ({)  ~  Vw,i  (0^(0 


{5,  -  WU  (?)  -  Rf,  (?)]+  Si(Wi  (?)  +  R,  0 t))cwr , 


(1.6.5) 


-  (')  -  */j  Mf  <5,-  (<f,  (<) + R,  (<))<w 

=  0Jr,iMr,i-\Ri-\  (0  -  A-,i  {t)Ri  (0 

-[5  -»/.<  (')  -  (0]N,  (>f,  (<) + r,  (<)k,,( 

^ f  i  *  ✓  x  ✓  x 

—^t - ^  OrjMrJ-1  v) Rf  (0 

+[5  -  k.<  (')  -  */.<  (<)]+  4  K-  (0 + W)^ 

~Rf,i  (t)0r,i  ~  r,iRf,i  (0 


(1.6.6) 


(1.6.7) 


(1.6.8) 


Finally,  at  the  strip  nearest  the  beach/Homeland  border,  evaluate  (1.6.7)  at  i  =  I  and 
interpret  the  term  /j,.jRj  (t)  as  the  instantaneous  rate  at  which  hostile  Reds  that  are  not 
being  followed  enter  the  homeland  (i.e.,  “leak”). 

Case  2.  Same  as  above,  but  each  subdomain  T>i  always  contains  the  same  number  of 
Ws,  i.e.  wt  =  Wt  (?) .  If  a  W  is  erroneously  identified  as  R  and  escorted  to  Quarantine,  it  is 

examined  and  released  after  a  delay.  Assume  that  replacement  by  another  W 
occurs  immediately. 

1.6.1.  Steady-State  or  Long-Run  Equations  for  the  Strip  Search  Model 

Again,  as  in  Section  1.3,  assume  that  all  rate  parameters  are  constant.  We  obtain  a 
collection  of  41  non-linear  equations.  If 

JFi(f)-»  and  then  if  as  before 

4  MO +4  ('))=<*»*(  Wj  +  77 ),  Sj  a  constant,  we  find 


0  =  K  ~  Rw,\w\  ~  pi  -  wf,\  -  7,  1  ]+  5\w\cwr,\ 

0  =  p  -  w/;1  -  rf  l  ]+  Sxwxcwri  -  w/;1  +  M*w ,1 ) 

0  =  4,.-  Mr,i  n  ~  p!  -  wf>i  -  rf  i  ]+  5xrxcrri 
0  =  P  -  w/4  -  7,1  ]+  5\rlcrr,\  -  7,1  (7,1  +  Rr,\  ) 
For  subsequent  slices  we  get  for  i= 2,3,. . 


_Si~wf,i~rf,i]  Siwicwr,i 


0  =  0Jw,iMw,i-\  wi-\  ~  Mw,iwi  ~  [7  -  wf,i  -  7,i 
0  =  7wAw,Mw/,M  +  [7  -  wf,i  ~  rf,i  ]+  Siwicwr,i  ~  wf,i  [h,i  +  Mw,i ) 


'iricrr,i 


®  ^r,iRr,i-\  7-1  Rr,iri  pi  wf,i  rf,i\  7' 

0  ,iRr  ,i—\r f  ,i—\  pi  —  wf,i  —  rf,i  ]  ^iricrr,i  ~  rf,i  [&r,i  Rr,i  j 


(1.6.9a) 


(1.6.9b) 
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Letting  px 


wf,\+rf,\ 


4'  =  Mw,l  A  +  (!  -  A )  S\S\w\cwr,\ 
or 

A w 


W[  — 


Av,l  +  (1_  P\)S\8\cwr,l 


7  (1_  P\)S\cwr,\ 

wf,  t  =  — - * - A 

<Pw,\  +  Mw,l 


51  (1“  aMcw,1 

/  * 

Av,l  +  Av,l 

_  At’,1  +  (!  -  A  )  7^1cwr,l  _ 

r\  = 


/L 


A%1  +  (1_  P\)S\8\ctr,\ 


S\  (1  -  px)S\c,rX 
7,i=  .  *  ri 

rr,\  Mr,  1 


7  a)7c?t,i 

Xr 

$r,l  /^r,l 

Mr,  1  “t  (l  —  A  ) ^l^crr,l 

where  px  satisfies  the  equation 

wf,  l  +  rf,  l 


A  =■ 


>1 


1 

7(,_a)^icw,i 

1  * 

,  w.l  +  Mw^ 

_  At'  +  ^1  (l “  A  )  <^cw,l  _ 

l 

_l _ 

7  (i_  a)7c?t,h 

Xy 

7 

^r,l  /^r,l 

Mr,\  "1"  7  0  _  A  )  ^\crr,  1 

For  i=2,3,. . .,/,  letting 


A  = 


wf,i  +  rf,i 


S; 


(1.6.7a) 


(1.6.7b) 


(1.6.7c) 


(1.6.7d) 


(1.6.7e) 
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(1.6.8a) 


®w,i  Pw,i- 1  wz  -1 
/Ay  (1  —  Pi  ) ^i^icwr,i 


* 

^wj  Pw,i-lwf  ,i-\ 

+ 

i 

2^1 

1 

2? 

6 

y 

_ i 

* 

*  vyi 

1 

+ 

i _ 

1 

+ 

i _ 

* 

0Jw,iPw,i-\  wf,i—\ 

_1_ 

Sii}~  Pi)Sicwr,i 

MwjPwj-VWi- 1 

1 

+ 

f  * 

i _ 

1 

1 

-f 

+ 

f  * 

i _ 

Pw,i  0  —  Pi )  ^i^icwr,i 

(1.6.8b) 


<®r,iPr,i-\ri-\ 


Pr,i  ^  Pi)^i^icrr,i 


rf,i  = 


®r,iPr,i-\rf,i—\ 
$r.i  // y 


+ 


^  Pi )  c\crr,i 
$r,i  P r  J 


* 

,iPr  ,i—\r f  ,i-\ 

_1_ 

'  Pi )  ^ icrr,i 

®r,iPr,i—\  wi-\ 

1 

*  C 

A 

+ 

_ i 

I 

1 

- 1 

*  c 

+ 

Pr,i  (1  —  Pi )  ^i^icrr,i 

(1.6.8c) 


(1.6.8d) 


where  pt  satisfies  the  equation 


wf,i+rf,i 

P!’—r~ 


1 

* 

i 

1 

2? 

6 

_ i 

i 

i?' 

+ 

t; 

JS  * 

i _ 

1 

1 

+ 

■fc 

jS  * 

i _ 

Pw,i  0  —  Pi )  ^Acwr,i 

0)r,iPr,i-\}"f,i-\ 

1 

Jjol 

1 

>8 

_ 1 

,iPr  ,i-\  f'-l 

1 

+ 

J* 

1 _ 

1 

1 

+ 

1= 

JS  * 

1 _ 

Pr,i  0  —  Pi )  ^i^ictr,i 

(1.6.8e) 


2.  Model  2:  A  Stochastic  Model  with  One  Red  Entering  the  Domain  at  Time  0 
2.1.  Simple  MDA  Scenarios 

Start  with  the  number  of  white  vessels  (Ws)  at  time  0,  W(0)-w  in  a  domain  V  ,  and 
allow  either  new  W  arrivals  if  a  W  is  wrongly  removed,  or  allow  replacements  (there  are 
several  arrivals);  there  are  a  constant  number  of  Ws  in  the  domain.  At  t  =  0  a  single 
hostile/lethal  R  enters  the  domain.  When  in  free/search  the  (single)  overhead  (OH)  sensor 
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(<S)  encounters  any  platform  W  or  R  at  time  t  with  probability  8{W  (t)  + 1  )dt  if  the  R  has 

not  been  identified  earlier  (time  <t),  where  W  (t)  is  the  number  of  White  vessels  at  time  t. 
If  the  W  is  misidentified  as  an  R,  the  S  follows  (tracks)  it  for  a  random  time  until  a  DD 

(pair)  approaches  and  takes  over  from  the  S,  and  the  S  returns  to  searching  V  . 

We  will  concentrate  on  the  set  of  cases  that  become  progressively  more 
mathematically  involved  (but  also  more  operationally  realistic  and  significant). 

2.2.  The  Number  of  Ws  in  V  is  Constant  (=w) 

Suppose  S  searches  V  at  random  at  rate  S(w)  (or  S(t;w)  (see  Section  1.5,  where  r 

is  the  time  S  spends  classifying  a  vessel)  and  encounters  a  W  (before  an  R)  with 

probability  wl(w  + 1) .  If  it  encounters  “something”  and  it  is  a  W,  it  classifies  it  correctly 
with  probability  cww(r) ,  and  releases  it  and  continues  searching  after  the  classification 
time  t  . 

Note  that  another  case  is  one  in  which  such  a  discovery  might  be  followed  by  tagging 
the  particular  platfonn  correctly  as  a  W,  in  which  case  it  is  ignored  on  future  encounters; 
the  Automatic  Identification  System  (AIS)  is  a  possible  way  of  tagging/identifying  a 
(subset  of)  Ws,  but  is  not  infallible,  being  subject  to  interference,  system  failure,  and 
conceivably  jamming  or  deception.  But  if  it  is  the  R  that  is  encountered  and  misclassified 
as  a  W,  then  the  R  may  be  ignored  in  future  searches,  and  should  make  it  to  the  lower 
boundary  V  of  V  and  be  able  to  invade  the  homeland  We  analyze  this  kind  of 

situation  later. 
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2.2.1.  Backward  Equation  for  Time  of  Capture  and  Probability  of  Capture  of  Single 
Hostile  R  for  Quarantine  Before  Homeland  2?(//)  is  Entered 

Let  a  single  R  enter  V  at  the  upper  boundary  V  at  t=  0.  There  are  W  (0)  =  w  Ws  in 
V  initially,  and  this  number  remains  constant,  at  w,  perhaps  by  replacement  if  any  W 
misidentified  as  R  and  followed  and  escorted  to  quarantine  (Q).  Let  Trq  ( uj  denote  the 

time  an  R  survives  being  taken  to  quarantine. 

Assume  initially  that  Xi  (7=1,2,...)  are  successive  times  between  detection  of 
platforms;  they  are  independent  identically  distributed  (iid)  random  variables  (rvs). 

2.2.2.  Benchmark  Example 

Let  the  time  between  detections  be  A, .  Then  a  conventional  example  is  that  time  to 
detection  is  exponential  with  rate  proportional  to  the  number  of  targets  present: 

P{Xj  (w)  >  =  exp(-£(w+l)t) .  (2.2.1) 

This  need  not  be  assumed,  but  is  convenient.  In  fact,  any  sequence  of  independent 
identically  distributed  random  variables  (iid  rvs)  is  possible,  and  analytically  tractable  in 
the  present  situation.  Let  Z>,  be  the  ith  follow  (or  tracking)  period  for  any  platform 
selected  to  follow  (that  has  been  classified  correctly  or  incorrectly,  as  R).  At  the  end  of 
follow  periods,  the  platform  is  released  to  the  Diverters  (e.g.,  destroyers  (DDs)). 

Note:  We  only  study  the  stages  involved  in  Detection  and  Follow  to  the  DDs  at 
present.  We  assume  that  a  correct  classification  is  made  (almost)  as  soon  as  the  diverter 
(D)  reaches  the  platform. 
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2.2.3.  Backward  Equation  Logic 


The  R  is  allowed  to  move  into  V ,  and  the  overhead  sensor  S  is  in  search  until  a 


platform/(potential  quarry)  is  detected;  the  platform  is  then  classified  for  time  r ;  it  is 
classified  as  a  W  with  probability  (r) ,  and  as  an  R  with  probability  q>  (r) . 

Consider  the  time  until  first  detection,  and  the  subsequent  possibilities: 

(a)  If  the  R  is  detected  first,  and  correctly  classified  as  an  R,  it  is  followed  to  a 
signaled  D;  this  requires  a  relatively  long  random  time  D  (a  strong  assumption 
that  can  be  relaxed).  Assume  also  that  there  is  always  a  D  available  upon  request. 
In  this  case,  the  R  is  detected  first  and  is  correctly  followed  to  D  in  time  X  +  D 


with  probability  — — -c,r(r). 


(b)  If  the  R  is  detected  first  and  misidentified  as  a  W  it  is  released.  The  time  this 


event  takes  place  is  at  t  =  X,  and  its  probability  is  - cm,(z) .  The 

w  + 1 


process  restarts. 

(c)  If  a  W  is  detected  first  and  correctly  identified  as  a  W,  then  it  is  released  and  S 


immediately  begins  to  search  again.  In  this  case,  the  first  time  length  is  X  with 

probability  — —  cww(z) .  The  search  for  the  R  begins  again  from  scratch. 
w  +  1 

(d)  If  a  W  is  detected  first  and  misclassified  as  an  R,  then  a  D  is  summoned  with 
probability  cw/.(z ) .  In  this  case,  the  time  taken  by  a  complete  first  step/event  is 
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w 

X  +  D  with  probability  - cwr ;  at  the  end  of  this  step,  the  S  begins  to  search 

w  + 1 

again  from  scratch. 

Note  that  there  are  natural  exceptions  to  the  behavior  described,  such  as  pointed  out 
in  (a).  We  address  these  later. 

Then  for  this  model 

(a’)  J  [w)  =  X  +  D  with  probability  — - — crr  ( r) 

w  +  l 

(b’)  Trq(w)  =  X' +  Trq(w)  with  probability  — - — crw  ( r) 

w  +  l 

(o’)  Trq(w)  =  X  +Trq(w)  with  probability - -cvvvv(r) 

w  +  l 

(d’)  Trq  (w)  =  X'”  +  D'  +  Trq  (w)  with  probability - cwr  (r) 

w  +  l 

the  various  different  apostrophes  indicate  that  the  rvs  are  iid  replicas  of  the  basic  X,D 
components,  and  those  on  Trq  on  the  right  side  indicate  that  the  search  process  starts  over 
“from  scratch.” 

Now  compute  the  Laplace-Stieltjes  transform  of  Trq  (w) :  at  least  for  transform 
variable  s  >  0  and  using  independence  where  needed,  conditioning  as  needed  gives 
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- 7crw  (r)  + - 7cww  (r) 

w  + 1  w  +  1 


E  e  sTrq(W)  =E  e  s{X+D) 

+£re-^]i<r^(w)ir^c,.w(r)  +  ^cww(r) 

L  J  L  J|_w+1  w  +  1 

+E\e-4x+i>)]E\e-°W]^c(T) 

J  L  J  w  + 1 

1 ~ E[e~sX ]  ~^\c™ (r) + ^TiCww (r) + E[e~S° ' 


(2.2.2) 


Let  pq  (t\w)  be  the  probability  that  R  is  captured  by  D  in  time  t  given  there  are  w  Ws 


in  the  domain.  If  s  — >  0 ,  E\e 


,-STrq{"’) 


■  pq  (go;  w)  the  probability  that,  if  the  domain  V  is 


of  infinite  width,  or  requires  an  infinite  traversal  time,  the  R  is  eventually  captured  by  D 
and  escorted  to  Q;  then  we  see  from  (2.2.2)  that  p  (oo;w)  =  1 . 

Special  Tractable  Case:  Exponential  Red  Transit  Time 

Let  the  probability  distribution  of  the  time  for  R  to  reach  the  lower  boundary  V 
starting  at  any  point  in  the  domain  V  if  it  has  not  yet  been  linked  to  D  be  exp(  pr  ), 
i.e.,  exponential  with  mean  1/ pr.  Then  it  can  be  seen  that,  conditional  on  Tqr  ( w) ,  the 

probability  of  R  capture  before  leakage  is  just  E  e  ^'Jrq ^  ;  the  result  of  setting  s  =  pr 


in  (2.2.2).  Notice  that  this  probability  is  1  if  pr  -  0 ,  so  the  mean  transit  time  through  Voi 

R  is  very  large:  I  /  pr  =  co  .  Otherwise  if  R’s  mean  transit  time  I  /  pr  =  0  or  //,.-»  oo ,  then 
there  is  no  time  to  detect  and  follow  such  a  fast-moving  target. 

s' T  ( 

Differentiate  E  e  s  rg{"  with  respect  to  s  and  change  sign  to  obtain 
s'  T  ( w) 

E  Trq  (w'je  s  ,Y,  U  .  If  s  -  pr ;  this  is  the  mean  time  of  capture  by  D  in  the  event  that  R 
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has  not  yet  reached  V .  The  conditional  expectation/mean  time  to  capture  R  for 
quarantine  is 


E\LTrq{w)\Trq{w)<™\ 


E 

T 

Lrq 

,( w)  exp  7^  (w)] 

E 

exp  {-HrTrq  (w)} 

(2.2.3) 


which  can  be  evaluated  by  evaluating  the  Laplace  transform  (2.2.2)  and  its  derivative 
at  s  -  nr . 

Appendix  A  presents  results  for  a  special  case  in  which  X  and  D  are  independent  and 
exponentially  distributed. 

2.3.  A  Strip-Search  Approximation  for  Gamma  (Erlang)  Red  Transit  Times 

It  has  been  initially  assumed  that  a  Red’s  unopposed  transit  time  of  V is  exponentially 


distributed  with  mean  jur .  This  assumption  can  conveniently  be  made  more  physically 
plausible  by  dividing  V  into  parallel  strips,  as  in  (1.6),  and  assuming  that  the  times  to 


pass  through  consecutive  strips  are  independently  exponential;  if  there  are  /  >  1  strips,  say 
7  =  12,  then  the  mean  transit  time  is  ////,.,  with  variance  /  /  //,2  and  coefficient  of 

variation  1//,  the  square  root,  1  /V7,  giving  an  assessment  of  the  variability  of  transit 
time,  expressed  as  a  fraction  of  its  mean.  Approximations  for  the  probability  that  R  is 
detected,  correctly  classified,  and  escorted  in  this  case  are  presented  in  Section  5. 

2.4.  W  Reduction  and  Identification 

A  hostile  R  wishing  to  cross  a  littoral  V  is  searched-for  by  an  OH  facility  (e.g.,  a  P3 
a/c),  S,  but  that  search  is  inhibited  by  the  presence  of  many  “false  targets,”  the  Ws.  One 


technology  that  the  Blue  S,  and  other  Blue  assets  can  exploit  to  deal  with  the  many  Ws  or 
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single  (or  multiple)  Rs  situation  is  the  Automatic  Identification  System  (AIS).  This 
system  places  an  RF  transponder  on  friendly  Ws  (or  a  subset  of  all).  The  transponder 
periodically  transmits  the  identity,  location,  and  properties  such  as  course  and  speed,  to 
the  W  platforms  in  line  of  sight,  and  there  exist  plans  to  transmit  this  information  to  a 
Far  Overhead  Satellite,  or  the  equivalent,  from  which  it  is  sent  to  a  central  database.  The 
AIS  is  not  perfect,  (e.g.,  two  vessels  within  a  short  distance  of  each  other  can  block  each 
other’s  signals;  there  can  also  be  system  failures  and  environmental  miseffects). 
However,  AlS-equipped  Ws  (a  subset  of  all)  ease  the  task  of  S.  A  model  for  assessing 

vessel  detection/classification  by  an  overhead  AIS  receiver  appears  in  Section  6. 

3.  Model  3:  A  Level-Dependent  Quasi-Birth  and  -Death  Model:  A  Markovian  Model 
in  Which  More  than  One  R  Travels  Through  the  Region 
3.1.  Formulation:  MDA  Situation  and  Model 

In  this  section,  more  than  one  Red  vessel  can  be  in  the  Maritime  Domain  at  a  time. 
Assume  Red  vessels  arrive  at  a  Maritime  Domain  D  according  to  a  Poisson  process  with 

rate  f. .  Unless  intercepted  first,  Red  (R)  spends  an  exponential  time  in  the  domain  with 
mean  1 I  /u .  There  is  one  overhead  surveillance  sensor  S.  The  time  until  the  sensor  finds 

and  correctly  classifies  each  R  in  the  domain  is  an  exponential  random  variable  with 
mean  1/  S0  independent  of  everything;  successive  detections  are  independent.  We  assume 

the  number  of  White  (W)  vessels  in  V  is  constant;  if  one  moves  from  V  another  quickly 

replaces  it.  Assume  the  S will  become  busy  following  a  (misclassified)  W  after  an 

exponential  time  with  mean  1  /  Sw ;  all  times  are  assumed  independent.  The  S  follows 
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(tracks)  any  vessels  classified  as  R  for  an  exponential  time  with  mean  1 1  <j> .  The  vessel 
classified  as  R  is  escorted  by  destroyer  pair  (DD)  after  the  ^following  time. 

Let  R[t)  -  ( n,f )  if  there  are  n  unescorted  R  vessels  in  the  domain  and  the  OH  is  busy 
following  (tracking)  a  misclassified  W  at  time  t.  Let  R(t)  -  (n,s)  if  there  are  n  unescorted 
R  vessels  in  the  domain  and  OH  is  searching  for  Rs  at  time  t.  Let  R(t)  =  ( n,c )  if  there  are 
n  unescorted  R  vessels  in  the  domain  and  the  t/is  following  a  R  at  time  t. 

3.2.  States  and  Their  Transitions 

P{R(t  +  h)  =  ( n  + 1,/)  |  /?(t)  =  (ft,/)}  =  A rh  +  o[hy.  New  R  arrival;  B  following  W 
P{R(t  +  h)  =  ( n-\,f ) |  l?(t)  =  («,/)}  =  njuh  +  o(h ):  An  R  leaves  T>\  B  following  W 
P[R(t  +  h)  =  ( ft, 5 )  |  R(t)  =  («,/)}  =  <j>h  +  o(h ) :  R  unchanged;  B  stops  following  W  ("free") 

P{R(t  +  h)  =  («  +  l,s)  |  R(t)  =  (h, 5)}  =  Ayh  +  o(h)\  New  R  arrival;  B  "free"  searching 

P{R(t  +  h)  =  (ft  -l,s)  |  R(t)  =  («, 5)}  =  ft///;  +  o(h)\  An  R  leaves  1>,  B  "free"  searching 

P{R(t  +  h)  =  (ft,/)  |  R(t)  =  («, 5)}  =  Swh  +  o(h ) :  A  W  is  misclassified  as  R;  B  starts  to  track  (follow) 

P[R(t  +  h)  =  (n  -l,c)  |  R{t)  =  (ft, 5)}  =  uSqIi  +  o(h):  An  R  is  classified  as  R;  B  starts  to  follow 

P{R(t  +  h)  =  ( n,s )  |  /?(t)  =  (n,c)}  =  0h  +  o(h):  Rs  unchanged;  B  stops  following  R 

P{R(t  +  h)  =  (ft  -l,c)  |i?(t)  =  (ft,c)}  =  nnh  +  o(h ) :  An  unescorted  R  leaves  V\  B  following  an  R 

P[R(t  +  h)-{n  + 1  ,c)  |  R(t)  =  (ft, c)}  =  Arh  +  o(h)\  New  R  arrival;  B  following  an  R 

The  process  {/?(t);t>0}  is  an  example  of  a  level-dependent  quasi-birth  and  -death 

process;  cf  (Bean  et  al.  (2000),  Bright  and  Taylor  (1995),  and  Gaver  et  al.(1984) 

3.3.  Limiting  Distributions 

Let  n (n,i)~  lim  T’|/?(t)  =  (ft,/)} . 

t— >CC 
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The  balance  equations  are 


[2,.  +Sw]n(0,s)  -  fi7r(l,s)  +  far(O,f)  +  07r(O,c) 

[K  +<£\7i(0,f)  =  im{\,f)  +  8w7t(0,s)  .  (3.3.1) 

[2,.  +  ^]/r(0  ,c)  =  ///r(l,c)  +  Sq7t{\,s) 

For  n>0 

[2,.  +  5W  +  «[//  +  <5o  ]]  7r(w’*s')  =  {n  +  \')n7z{n  +  \,s)  +  </>7z{n,f}  +  $7z{n,c')  +  ArK{n-\,s) 

[✓L,.  +  n/j]7r(n,  /)  =  («  +  \)/u7r(n  +  \,f)  +  8w7t(<n, 5)  +  Ar7t(n-l,f)  .  (3.3.2) 

[2,.  +</)  +  n/ii\n(n,c)  —  («  + 1)  fin{n  +  l,c)  +  SqTt^h  +  l,s)  +  A,r7i(n  -  l,c) 

A  recursive  procedure  to  compute  the  limiting  distribution  for  the  model  appears  in 
Appendix  B. 

The  long  run  fraction  of  Rs  that  exit  the  area  without  being  escorted  by  DDs 
(probability  of  R  leakage)  is 

00 

P\Leak }  =  —  y  n\jr(n,c)  +  7t(n,s)  +  n («,/)]  •  (3.3.3) 

^  n=0 

The  long  run  fraction  of  time  the  OH  follows  a  misclassified  W  is 

00 

^■(follow  misclassfied  W)  =  Z  *(",/)•  (3-3.4) 

n=0 
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4.  Numerical  Examples  Comparing  the  Results  Using  the  Deterministic  and  the 
Markovian  Stochastic  Models 

Consider  a  rectangular  domain,  D,  with  width  in  the  x-direction  Mx  =  100  NM  and 

length  in  the  y-direction  My  NM  for  various  My  .  Assume  the  OH  sensor  footprint  is  a 
square  with  sides  /  =  25  NM.  Assume  vessels  travel  through  the  domain  in  the 
y-direction.  Assume  the  parameters  in  Table  4.1. 


Velocity  of  White  vessel 

W 

15  kts 

Velocity  of  Red  vessel 

A 

15  kts 

Velocity  of  OH  sensor 

vs 

250  kts 

Velocity  of  DD  (pair) 

vd 

30  kts. 

Arrival  rate  of  Rs 

K 

variable 

Arrival  rate  of  Ws 

A w 

variable 

y-direction  length  of  rectangle 

My 

variable 

x-direction  length  of  rectangle 

Mx 

200  NM 

Side  of  square  of  OH  sensor  footprint 

f 

25  NM 

Mean  time  to  classify  detected  vessel 

T 

2/60  hrs 

Number  of  OH  sensors 

s 

1 

Prob.  correctly  classifying  an  R 

crr 

variable 

Prob.  correctly  classifying  a  W 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  4.1  Parameter  Values  for  Examples  of  Section  4.2 
4.1.  A  Model  for  the  Detection  Rate  of  Vessels 

The  total  time  for  the  S  sensor  to  cover  a  one  footprint  square  is  /  /  vs .  The  mean 


time  for  the  S  to  cover  the  domain  is 


MxxMy/f 


The  mean  time  a  W  is  in  the 


domain  is 


—  = My/vw ;  the  mean  time  a  Red  vessel  is  in  the  domain  is  —  =  My/vr.  If 

Mw  '  A- 


no  vessels  are  ever  classified  as  Red,  then  the  limiting  mean  number  of  Ws  (respectively 
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Rs)  in  the  domain  is  A^v  /  juw  (respectively  Ar  /  ).  We  assume  the  constant  detection  rate 


per  vessel  is 


i-i 


siT)  =  Pd 


MXM 
- —  +  r 

K>  ,  K 

mean  time 

V 

mean  time 

for  OH 

to  class. 

to  cover 

vessels 

domain 

in 

domain 

(4.1.1) 


which  decreases  as  r  increases,  as  it  should.  The  mean  time  until  a  searching  S detects 


and  misclassifies  a  W  is  1  /  Sw,  where  Sw  -  S(t) cwr  .  The  mean  time  until  a  searching 

Mw 

S  detects  and  correctly  classifies  an  R  is  1  /S0,  where  S0  =  r>(r)en. .  The  time  the  S 

MJ2 

follows  a  vessel  classified  as  R  has  an  exponential  distribution  with  mean  \l  (j>  =  — - — . 

vd 

4.2.  Numerical  Examples 

Figures  4.1  and  4.2  display  the  long  run  fraction  of  Rs  that  leak  through  defenses, 
(3.3),  as  a  function  of  the  arrival  rate  of  Rs  for  a  fixed  number  of  Ws  equal  to  0,  100,  and 
1,000.  The  velocity  of  the  DD  pair  that  relieves  the  following  S  is  30  kts.  In  Figure  4.1, 
the  probability  of  correct  classification  cww  =  crr  =  0.99  ;  in  Figure  4.2  it  is  0.90. 
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Fraction  of  R  Leakage  Fraction  R  Leakage 


Multi-Dimensional  Markov  Chain  Model  (Section  3) 
Fraction  of  Rs  that  Leak  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
cww=0.99;  crr=0.99 


1.00 
0.90 
0.80 
0.70 
0.60 
0.50 
0.40 
0.30 
0.20 
0.10 
0.00 

0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1 

Arrival  Rate  of  Rs  per  Day 
Figure  4.1 


-  w=1000 

-  w=100 

-  w=0 


Multi-Dimensional  Markov  Model  (Section  3) 

Fraction  of  Rs  that  Leak  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
cww=0.90;  crr=0.90 


Arrival  Rate  of  Rs  per  Day 
Figure  4.2 


30 


Fraction  of  Rs  that  Leak 


A  deterministic  model  for  this  scenario  was  introduced  in  Section  1.  The  model  is  a 


system  of  differential  equations.  Figures  4.  Id  and  4.2d  display  the  normalized  R  leakage 


rate  (the  long  run  average  leakage  rate  divided  by  the  R  arrival  rate)  from  that  model. 


Deterministic  Model  (Section  1) 

Fraction  of  Red  Entrants  that  Leak  to  Blue  HL 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
cww=0.99;  crr=0.99 


-w=1000 
-w=100 
-  w=0 


Arrival  Rate  of  Rs  (per  Day) 
Figure  4. Id 
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Deterministic  Model  (Section  1) 

Fraction  of  Red  Entrants  that  Leak  to  Blue  HL 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
cww=0.90;  crr=0.90 


-w=1000 

-w=100 

-w=0 


Arrival  Rate  of  Rs  (per  Day) 
Figure  4.2d 


Discussion:  As  the  arrival  rate  increases  the  fraction  of  Rs  leaking  through  the 
defenses  increases.  Comparison  of  Figures  4.1  and  4.2  suggests  that  the  ability  to 
correctly  classify  vessels  becomes  more  important  as  the  number  of  Ws  increases. 
Comparison  of  Figures  4. 1  and  4.  Id  and  Figures  4.2  and  4.2d  suggest  that  the  two  models 
provide  the  same  qualitative  results.  The  deterministic  model  is  more  pessimistic  than  the 
stochastic  model.  For  the  parameter  values  considered,  the  stochastic  model  represents 
the  possibility  of  having  0  Rs  in  the  domain  when  the  arrival  rate  of  Rs  is  positive;  during 
this  time  there  can  be  no  leakage.  For  the  parameters  considered,  the  deterministic  model 
is  unable  to  represent  this  possibility  and  so  there  is  always  R  leakage;  the  pessimistic 
behavior  is  the  result.  The  number  of  Ws  in  the  domain  greatly  influences  the 
leakage  rate. 


32 


Figure  4.3  displays  the  long  run  fraction  of  Rs  that  leak  through  defenses  as  the 
probability  of  correct  classification  increases.  The  velocity  of  the  relief  platform  for  the 
following  OH  is  30  kts. 


Multi-Dimensional  Markov  Model  (Section  3) 
Fraction  of  Rs  that  Leak  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direct=200  NM 
lamr=0.5  per  day 


Figure  4.3d  presents  the  normalized  leakage  rate  resulting  from  the  deterministic 
model  of  Section  1 . 
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Deterministic  Model  (Section  1) 

Fraction  of  Red  Entrants  that  Leak  to  Blue  HL 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
lamr=0.5  per  day 


In  Section  2,  a  stochastic  model  is  introduced  in  which  there  are  a  constant  number  of 
Ws  in  the  domain  and  one  R  enters  the  domain  at  time  0.  R  leaks  through  the  defenses  if 
it  transits  through  the  domain  before  it  is  detected,  correctly  classified,  and  a  platform 
arrives  to  escort  it.  This  model  differs  from  that  model  of  Section  3.2  in  that  there  is  only 
one  R  in  the  domain.  Figure  4.3s  displays  the  probability  that  one  Red  leaks  through  the 
defenses  as  a  function  of  the  probability  that  a  vessel  is  correctly  classified. 
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One  Red  Enters  the  Region  at  Time  0  (Section  2) 
Probability  the  One  Red  Leaks  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 


Discussion:  If  there  are  0  Ws,  then  increasing  the  probability  of  correct  classification 
does  not  have  much  impact.  Recall  that  each  classification  takes  a  mean  time  of  2 
minutes.  Thus,  even  with  perfect  classification,  the  presence  of  Ws  increases  the  fraction 
of  Rs  that  leak  through  the  defenses.  The  decreased  number  of  Ws  from 
1,000  to  100  results  in  a  larger  increase  in  the  probability  that  Red  can  be  neutralized, 
rather  than  increasing  the  probability  of  correct  classification  to  0.95.  Decreasing  the 
number  of  W  to  0  results  in  a  larger  probability  of  correct  classification  than  increasing 
the  probability  of  correct  classification  to  1  when  the  number  of  Ws=100.  Comparison  of 
Figures  4.3,  4.3d,  and  4.3s  indicates  that  the  three  models  give  very  similar  quantitative 
results.  Once  again,  the  detenninistic  model  is  more  pessimistic  than  the  model  of 
Section  3.2. 
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Figure  4.4  displays  the  long  run  fraction  of  Rs  that  leak  through  the  defenses  as  a 


function  of  the  velocity  of  the  platform  that  relieves  a  following  S. 


Multi-Dimensional  Markov  Model  (Section  3) 
Fraction  of  Rs  that  Leak  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direct=200  NM 
lamr=0.5  per  day;  cww=0.99;  crr=0.99 


Velocity  of  Relief  Platform  for  Tracking  OH  (NM  per  hr) 
Figure  4.4 


Figure  4.4d  displays  the  normalized  R  leakage  rates  resulting  from  the  deterministic 
model  of  Section  1.  Figure  4.4s  displays  the  probability  the  one  R  leaks  through  the 
defenses  for  the  stochastic  model,  in  which  one  R  enters  the  domain  at  time  0  and  there 
are  a  constant  number  of  Ws  in  the  domain  from  Section  2. 
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Deterministic  Model  (Section  1) 

Fraction  of  Red  Entrants  that  Leak  to  Blue  HL 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
lamr=0.5  per  day;  cww=0.99;  crr=0.99 


One  Red  Enters  Region  at  Time  0  (Section  2) 
Probability  Red  Leaks  Through  Defenses 
Rectangular  Domain:  x-direction=100  NM;  y-direction=200  NM 
cww=0.99;  crr=0.99 
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Discussion:  The  baseline  relief  platform  for  a  following  S  is  a  pair  of  DDs.  The 


assumed  velocity  of  the  DD  is  30  kts.  The  use  of  another  air  platform  to  relieve  the  S so 
that  the  S can  continue  to  search  will  decrease  the  fraction  of  Rs  that  leak.  The  effect  is 

greater  the  larger  the  number  of  Ws.  Comparison  of  Figures  4.4,  4.4d,  and  4.4s  suggests 
that  the  three  models  result  in  very  similar  qualitative  behavior.  The  detenninistic  model 
has  larger  leakage  rates  than  the  model  of  Section  3.2.  Thus,  while  the  qualitative  results 
are  similar,  the  quantitative  results  are  different.  Decreasing  the  number  of  Ws  (the  false 
positive  rate)  provides  more  operational  benefit  than  decreasing  the  time  until  a  sensor 
following  a  suspicious  vessel  is  relieved. 

4.3.  The  Probability  a  Vessel  is  Classified  Correctly  is  a  Function  of  the  Time,  r,  that 
the  Sensor  S  Spends  Classifying  the  Vessel 

Assume  that  the  probability  of  correct  classification  of  a  vessel  of  type  j  is  a  function 
of  the  time  spent  classifying  the  vessel.  We  use  the  logistic  functional  form  of 
Section  1.5.2  and  the  detection  rate  (4.1.1). 

Table  4.2  displays  parameter  values  used  in  the  following  numerical  examples.  The 
arrival  rate  of  W  is  chosen  so  that  Aw  /  //w  is  equal  to  the  specified  number  of  Ws  in 
the  domain. 
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Number  of  Ws 

w 

variable 

Velocity  of  White  vessel 

vw 

15  kts 

Velocity  of  Red  vessel 

vr 

15  kts 

Velocity  of  OH  sensor 

vs 

250  kts 

Velocity  of  DD  (pair) 

vd 

30  kts 

Arrival  rate  of  Rs 

K 

1  per  day 

Arrival  rate  of  Ws 

A w 

variable 

y-direction  length  of  rectangle 

My 

200  NM 

x-direction  length  of  rectangle 

Mx 

100  NM 

Side  of  square  of  OH  sensor  footprint 

f 

25  NM 

Mean  time  to  classify  detected  vessel 

V 

variable 

Number  of  OH  sensors 

S 

1 

Prob.  correctly  classifying  an  R 

CfT 

variable 

Prob.  correctly  classifying  a  W 

^WW 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  4.2  Parameter  Values  for  Examples  in  Section  4.3 

Figure  4.5  displays  the  probabilities  of  correct  classification  as  a  function  of  time  for 
the  various  values  of  a  and  the  specified  probability  of  correct  classification  at  time 
5/60  hours.  Figures  4.5a  (respectively  4.5b)  display  the  long  run  fraction  of  Rs  that  leak 
for  a  =  2  and  a  specified  probability  of  correctly  classifying  a  W  equal  to  0.99 
(respectively  0.999)  for  the  model  of  Section  3.  Figures  4.6a  (respectively  4.6b)  display 
the  long  run  fraction  of  Rs  that  leak  for  a  =  3  and  a  specified  probability  of  correctly 
classifying  a  W  equal  to  0.99  (respectively  0.999)  for  the  model  of  Section  3.  All  of  the 
figures  have  a  specified  probability  of  correctly  classifying  an  R  equal  to  0.7. 
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Fraction  of  Rs  Leaking  Probability  of  Correct  Classification 


Probability  of  Correct  Classification  as  a  Function  of  Time  Spent 


— alpha=2;  prob.  at  time  5/60=0.999 
— •—  alpha=3;  prob  at  time  5/60  =0.999 
— alpha=2;  prob.  at  time  5/60=0.99 
— ■—  alpha=3;  prob.  at  time  5/60=0.99 
— alpha=2;  prob.  at  time  5/60=0.7 
alpha=3;  prob.  at  time  5/60=0.7 


Classification  Time  (hours) 
Figure  4.5 


Multi-Dimensional  Markov  Model  (Section  3) 

Long  Run  Average  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=2;  specified  cww=0.99  &  specified  crr=0.7  at  class,  time  5/60  hours 
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Fraction  of  Rs  that  Leak  Fraction  of  Rs  Leaking 


Multi-Dimensional  Markov  Model  (Section  3) 

Long  Run  Average  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=2;  specified  cww=0.999  &  specified  crr=0.7  at  class,  time  5/60  hours 


Multi-Dimensional  Markov  Model  (Section  3) 

Long  Run  Average  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=3;  specified  cww=0.99  &  specified  crr=0.7  at  class,  time  5/60  hours 
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Fraction  of  Rs  that  Leak 


Multi-Dimensional  Markov  Model  (Section  3) 

Long  Run  Average  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=3;  specified  cww=0.999  &  specified  crr=0.7  at  class,  time  5/60  hours 


— w=1000 
— w=100 
♦  w=0 
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Fraction  of  Rs  that  Leak 


Figures  4.5ad,  4.5bd,  4.6ad,  and  4.6bd  display  the  long  fraction  of  Rs  that  leak 
resulting  from  the  detenninistic  model  of  Section  1 . 


Deterministic  Model  (Section  1) 

Long  Run  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=2;  specified  cww=0.99  &  specified  crr=0.7  at  class  time  5/60 
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Fraction  of  Rs  Leaking  Fraction  of  Rs  that  Leak 


Deterministic  Model  (Section  1) 

Long  Run  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=2;  specified  cww=0.999  &  specified  crr=0.7  at  class  time  5/60 


Classification  Time  (hours) 
Figure  4.5bd 


— a— w=1000 
— w=100 


Deterministic  Model  (Section  1) 

Long  Run  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=3;  specified  cww=0.99  &  specified  crr=0.7  at  class  time  5/60 


— w=1000 
— w=100 
♦  w=0 
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Deterministic  Model  (Section  1) 

Long  Run  Fraction  of  Rs  Leaking  Through  Defenses 
alpha=3;  specified  cww=0.999  &  specified  crr=0.7  at  class,  time  5/60 
Domain=200  NM  in  y-dir  &  100  NM  in  x-dir;  sensor  speed  250  kts 


Discussion:  For  the  cases  of  the  number  of  Ws,  w,  explored,  the  minimizing 
classification  time  increases  as  the  specified  correct  classification  probability  at 
5/60  hours  decreases.  The  minimizing  classification  time  increases  as  a  increases.  The 
minimizing  classification  time  increases  as  the  number  of  Ws  decreases.  A  comparison 
of  the  results  from  the  stochastic  model  and  the  deterministic  model  suggests  that  both 
models  give  similar  qualitative  results.  The  resulting  R  leakage  rate  is  larger  for  the 
deterministic  model  than  that  for  the  stochastic  model.  The  classification  time  that 
minimizes  the  leakage  rate  for  the  deterministic  model  tends  to  be  smaller  than  that  for 
the  stochastic  model.  Once  again,  the  decreasing  the  false  positive  rate  (number  of  Ws) 
results  in  larger  probabilities  of  neutralizing  Rs  than  increasing  the  probability  of 
correct  classification. 
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5.  Non-Markovian  Models 


A  Maritime  domain  or  region  contains  a  number  w  of  nonhostile  W  vessels.  At  time 
0,  a  hostile  R  vessel  enters  the  domain.  An  overhead  friendly  (Blue)  sensor  (<5)  patrols  the 

domain  and  classifies  (perhaps  incorrectly)  detected  vessels  as  R  or  W.  The  S  follows 

(or  tracks)  any  vessel  it  classifies  as  R  until  it  is  relieved  by  a  DD.  The  <5Ts  here  assumed 

unable  to  detect  and  classify  additional  vessels  while  it  is  following  a  vessel.  We  assume 
an  unescorted  R  will  remain  in  the  domain  for  a  positive  random  time  having  a 
distribution  function  F;  the  sensor’s  following  times  of  vessels  classified  as  R  are 
independent  and  identically  distributed  nonnegative  random  variables;  and  the 
distribution  of  the  time  until  the  patrolling  sensor  detects  a  vessel  is  exponential. 

In  this  section,  we  present  two  approximations  to  the  probability  that  R  is  detected 
and  correctly  classified  before  leaving  the  domain  and  the  probability  that  R  is  detected, 
correctly  classified,  and  escorted  before  leaving  the  domain.  The  first  approximation  uses 
a  terminating  renewal  process  argument.  The  second  approximation  uses  an  alternating 
renewal  process  approximation.  The  usefulness  of  the  approximations  is  assessed  by 
comparing  the  results  of  the  approximations  to  more  detailed  simulation  models.  The 
approximations  appear  to  be  good  and  are  used  to  study  the  sensitivity  of  the  probability 
of  neutralizing  the  R  on  model  parameters. 

We  assume  the  domain  is  a  rectangle.  The  parameters  of  the  model  appear  in 
Table  5.1. 
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Velocity  of  Red  vessel 

15  kts 

Velocity  of  OH  sensor  S 

fs 

250  kts 

Velocity  of  DD  (pair) 

W 

30  kts 

Number  of  White  vessels 

w 

variable 

y-direction  length  of  rectangle 

My 

200  NM 

x-direction  length  of  rectangle 

Mx 

200  NM 

Side  of  square  of  OH  sensor  footprint 

f 

25  NM 

Mean  time  to  classify  detected  vessel 

V 

2/60  hrs 

Prob.  correctly  classifying  an  R 

Crr 

variable 

Prob.  correctly  classifying  a  W 

C\vw 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  5.1  Parameters  for  Section  5 


5.1.  A  Terminating  Renewal  Process  Approximation 


The  detection  rate  of  vessels  in  the  entire  domain  is  assumed  to  be 

r  -i-l 


So{?)  =  Pd 


MxMy 


mean  time 


for  OH 
to  cover 
region 


r  [tv  4- 1] 

mean  time 
to  class, 
vessels 
in 

region 


(5.1.1) 


We  assume  the  times  between  detections  are  independent  and  identically  distributed, 
having  an  exponential  distribution  with  mean  l/c>0  (r) .  Let  Tj-  be  the  first  time  a  vessel  is 

classified  as  R;  the  classified  vessel  could  be  White  (false  positive)  or  Red. 


p{Tf  N=2> 


e  /  \n 

-S0(t)  d()(rj 


n= 0 


w 


=  expj-b0(r) 
=  expj-b0(r) 


1- 


w 


n\ 


-  r  +  - 
Lww 


W+1C^  +  W+1( 


w  +  1  w  +  1 


(5.1.2) 


w 


-  c  +  - 
'-'wr  ^ 


w+1  w+1 
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Let  Tr  be  the  time  until  R  is  correctly  classified  as  R  and  Tw  be  the  first  time  a  W  is 
classified  as  an  R. 


P{Tw<Tr}  =  - 


w 

- < 

w+ 1 


w 


=  p 


(5.1.3) 


w  + 1 


c  + 
'-'wr  ~ 


w+ 1 


In  what  follows,  we  assume  p  >  0 . 

When  a  vessel  is  classified  as  R,  the  sensor  follows  (tracks)  the  vessel  until  relieved 
by  escort  vessels  (a  pair  of  DDs).  Assume  the  following  time,  Z>,  has  a  distribution  with 


mean  M  <f>  and  Laplace  transform  E  e  sD  =£D(s),  where  the  mean  time  the  overhead 


sensor  follows  a  vessel  classified  as  R  is 


1  /</>  = 


1 

vr+vd 


(5.1.4) 


5,1.1,  An  Approximation  to  the  Time  Until  R  is  Detected  and  Correctly  Classified 

The  probability  that  R  is  detected  and  correctly  classified  before  time  t  satisfies 
the  equation 

t 

P{Tr  <  t]  =  (1  -  p)P{Tf  <  t)  +  ^P{Tr  <  t  -  5}  pP\Tf  +DGds}.  (5.1 .5) 

0 

Thus,  the  probability  that  R  is  not  detected  and  correctly  classified  before  time  t 
satisfies  the  equation 

t 

P{Tr>t)=\-(\-p)p{Tf<t}-\p{Tr<t-s}pP{Tf  +  D  <=  c/.s| 

0  ,  •  <5 16> 
=  pP\Pf  -  +  -  pP'\Tf  +  D<t^  +  ^P[Tr  >t-s} pP^Pf  +  Deds^j 

0 
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Following  Feller  (1966)  p.  322,  assume  there  is  a  kq  >  0  that  satisfies  the  equation 


Let 


PE 


=  1. 


m#M=pe 


(Tf  +  D) 


eK° tP{Tr  >  t] 

=  eh'°l[pP{Tf  <  t]  +  p\rf  >  t]  -  pP[Tf  +D<t } 

t 

+^eK^t~s^P{Tr>t-s}eK^ pP [Tf+D 
0 

The  key  renewal  theorem  implies 

lim  eK°tp{Tr  >t}  =  , 

^°°  P M 


(5.1.7) 


(5.1.8) 


(5.1.9) 


(5.1.10) 


where  using  (5.1.2)  and  (5.1.7) 


cr(k o)  = 


Mr) 


w 

w  + 1 


c  + 


w  + 1 


w 


Ko 


So(T) 
<%(r) 


,  crr 

W+  1  W+  1 


-*o 


-[(l-p)  +  Kz>(-^o)] 


*"o 


w 


w+ 1 


C  + 


w  + 1 


4(r) 


w  i 

^lC^+—xCrr 


*0 


*0 

.  (5.1.11) 


Thus, 


F{rr>t}~ 


P#M 


(5.1.12) 
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Assume  an  unescorted  R  is  in  the  domain  for  a  time  having  a  distribution  F  with 
Laplace  transform  £R  (s) .  An  approximation  to  the  probability  that  R  is  not  detected  and 
correctly  classified  while  in  the  domain  is 


Q?(>o) 


Cr{k o)- 


(5.1.13) 


If  F  is  gamma  with  scale  m  and  shape  parameter  /? ,  then  an  approximation  to  the 


probability  R  is  not  detected  and  correctly  classified  while  in  the  domain  is 


cr{k o)  ® 

_m  +  K0 


(5.1.14) 


5.1.2.  An  Approximation  to  the  Probability  R  is  Detected,  Correctly  Classified,  and 
Escorted  Before  It  Leaves  the  Domain 

Let  Te  be  the  time  until  R  is  escorted. 


P{Te  <  t)  =  (1  -  p)P\Tf  +D<t}  +  \p{Te<t-s }  pP\Tf  +  D<=ds\  (5.1.15) 


Hence, 


P{Te  >  t]  =  1  -  (1  -  p)P{Tf  +  D  <  t]  -  J  P{Te  <  t  -  5}  pP\Tf  rflerfjj 

0 

t 

=  p[Tf  +  D>t]  +  ^\\-P{Te<t-s]]pP[Tf  +  D^ds]  (5.1.16) 

0 

t 

-  P^Tf  +  D  >  tj  +  ^ P{Te  >  t  -  s)  pP\Tf  +  D  e  <Aj. 


Assume  (5.1.7)  holds.  The  key  renewal  theorem  implies  that 

P\T  >  t]  ~ —^—^-e~Kot 
i  i  #l  \ 

P  (*o) 


(5.1.17) 
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where  //#  (xr0 )  is  given  by  (5. 1 .8)  and 


cEM  =  ——-  (5.1.18) 

Ko  P 

Assume  an  unescorted  and  unfollowed  R  is  in  the  domain  for  a  random  time  having  a 
distribution  F  with  Laplace  transform  C R  (.v) .  An  approximation  to  the  probability  that  R 
is  not  detected  and  correctly  classified  while  in  the  domain  is 

C-4t\CrM-  (5-1.19) 

p  K) 

If  F  is  a  gamma  distribution  with  scale  m  and  shape  parameter  ft ,  then  an 
approximation  to  the  probability  that  R  is  not  detected  and  correctly  classified  while  in 
the  domain  is 


fe(Ao)  & 

jU#(>C0)  _TU  +  K§ 


(5.1.20) 


5.2.  An  Alternating  Renewal  Process  Approximation 


Assume  only  Whites  are  in  the  domain.  Let 


i-i 


5  =  Pd 


MxMy 

mean  time 
for  OH 
to  cover 
region 


(5.2.1) 


The  sensor  alternates  between  looking  for  suspicious  vessels  and 
classifying/following  vessels.  The  expected  time  that  the  sensor  is  busy  when  it  detects  a 
vessel  (busy  period)  is 
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(5.2.2) 


E[B]  =  t  +  E[D]cwr. 


The  expected  time  between  busy  periods  is  1  ISw,  where  w  is  the  number  of 
White  vessels. 

The  long  run  unavailability  of  the  sensor  is 


a  - 


E[B 


—  +  E\B] 
Sw  L  J 


(5.2.3) 


The  long  run  availability  of  the  sensor  is 


1/ Sw  1 

±  +  e\b]  =  1  +  SwE[bY 

Sw  L  J 


(5.2.4) 


Assume  R  enters  the  domain  7?  when  the  system  is  in  steady  state.  Let 


S*=Sa.  (5.2.5) 

Approximate  the  distribution  of  the  time  until  R  is  detected  and  correctly  classified 

with  an  exponential  distribution  with  mean  — ^ - . 

S  c„.(r) 

5.2.1.  An  Approximation  to  the  Probability  that  R  is  Not  Detected  and  Correctly 
Classified  Before  It  Travels  Through  the  Domain 

Assume  an  unescorted  and  unfollowed  R  is  in  the  domain  for  a  random  time  having  a 
distribution  F  with  Laplace  transform  C R  (.y) .  An  approximation  to  the  probability  that  R 
is  not  detected  and  correctly  classified  while  in  the  domain  is 

Ol(ArW)-  (5.2.6) 
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Suppose  the  time  R  travels  through  the  domain  has  a  gamma  distribution  with  shape 

parameter  (3  and  mean  m  ;  the  scale  is  57  =  — .  An  approximation  to  the  probability  that 

m 

R  is  not  detected  and  correctly  classified  while  traveling  through  the  domain  is 

r  -\P 


57  + 


67 

8*  crr{r ) 


(5.2.7) 


5.2.2.  An  Approximation  to  the  Probability  that  Red  is  Not  Detected,  Correctly 
Classified  and  Escorted  Before  Traveling  Through  the  Domain 

To  obtain  an  approximation  to  the  probability  that  R  is  not  escorted  before  it  leaves 
the  domain,  assume  the  successive  times  the  sensor  follows  a  vessel  classified  as  R  are 
independent,  having  an  exponential  distribution  with  mean  (5.1.4).  The  probability  that  R 
is  not  escorted  before  time  t  is  approximately 

t 

P{Te  >t}*  e-S*c"‘  +  J S*crre-S*c"se-^-s)ds 


* 

~S  C  t  O  Cy 

—  g  u  <-rrl  _| _ 


5  Cyr  ( 


g-f _  e~S  crrt 


(5.2.8) 


Assume  an  unescorted  and  unfollowed  R  is  in  the  domain  for  a  random  time  having  a 
distribution  F  with  Laplace  transform^  (s) .  An  approximation  to  the  probability  that  R 
is  not  detected,  correctly  classified,  and  escorted  while  in  the  domain  is 


Cr  (  <5  *c  r  r ) 


+ 


8  c,. 


o  c,. 


Cr  {4>)~  Cr  l^*crr ) 


(5.2.9) 
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Suppose  the  time  R  travels  through  the  domain  has  a  gamma  distribution  with  shape 


parameter  / 3  and  mean  m  ;  the  scale  is  m  =  — .  An  approximation  to  the  probability  that  R 

m 

is  not  escorted  before  it  leaves  the  domain  is 

P  x*  \(  \P  (  \p 

O  Crr  57  57 

8*  Crr  -</>  \&  +  <!>  )  57  +  8*  crr 

5.3.  Comparison  of  the  Renewal  Process  Approximations  to  Results  from 
More  Detailed  Simulations 
5.3.1.  Simulation  1 

Sato  (2005)  presents  the  results  of  a  simulation.  In  the  simulation,  the  sensor 
following  times  and  the  time  an  unescorted  R  travels  through  the  domain  are  independent 
random  variables  having  gamma  distributions  with  the  same  shape  parameter.  The  mean 
of  the  sensor  following  time  is  given  by  (5.1.4).  The  mean  of  R’s  unescorted  travel  time 
through  the  domain  is  My/vr .  Table  5.2  displays  the  parameters  of  the  simulation  and 

the  simulation  results;  fc  is  the  fraction  of  replications  R  is  detected  and  correctly 
classified  before  it  leaves  the  domain;  fE  is  the  fraction  of  replications  R  is  detected, 
correctly  classified,  and  escorted  before  it  leaves  the  domain.  Each  case  has 
10,000  replications. 


(5.2.10) 
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Parameters  for  and  Results  from  a  Simulation  with  10,000  Replications 


Mx 

T 

(NM) 

w 

(kts) 

(minutes) 

81 

22 

11.3 

5 

81 

13 

11.3 

4.8 

144 

34 

10 

5.8 

50 

9 

22.5 

7 

50 

34 

22.5 

4.8 

159 

6 

15 

4.3 

97 

31 

16.3 

8 

144 

41 

10 

6.8 

66 

13 

27.5 

6.3 

128 

19 

26.3 

4.3 

284 

22 

12.5 

5.3 

97 

50 

16.3 

7.5 

238 

6 

18.8 

8 

175 

25 

20 

6 

175 

25 

20 

6 

222 

31 

13.8 

7.8 

113 

44 

21.3 

4 

300 

41 

17.5 

5 

300 

16 

17.5 

7.3 

253 

19 

23.8 

4 

206 

9 

30 

5.3 

191 

44 

25 

7.8 

128 

50 

26.3 

5.5 

206 

16 

30 

6.3 

238 

47 

18.8 

4.5 

191 

47 

25 

5.5 

269 

38 

28.8 

7.3 

269 

28 

28.8 

7 

Shape 


C\VW 

crr 

Parameter 

fc 

fE 

0.96 

0.96 

50 

0.9 

0.87 

0.94 

0.86 

25 

0.9 

0.86 

0.99 

0.85 

42 

0.82 

0.78 

0.91 

0.89 

36 

0.82 

0.74 

0.99 

0.85 

11 

0.77 

0.68 

0.92 

0.88 

19 

0.74 

0.67 

0.96 

0.83 

39 

0.64 

0.57 

0.91 

0.91 

8 

0.63 

0.56 

0.9 

0.86 

33 

0.63 

0.54 

0.98 

0.98 

50 

0.61 

0.53 

0.9 

0.96 

39 

0.56 

0.5 

0.94 

0.99 

33 

0.55 

0.49 

0.97 

0.88 

47 

0.55 

0.48 

0.95 

0.9 

28 

0.52 

0.45 

0.95 

0.9 

28 

0.52 

0.44 

0.93 

0.83 

5 

0.49 

0.42 

0.93 

0.93 

8 

0.48 

0.41 

0.99 

0.91 

19 

0.46 

0.4 

0.91 

0.95 

44 

0.46 

0.4 

0.94 

0.98 

16 

0.45 

0.36 

0.99 

0.89 

47 

0.44 

0.36 

0.98 

0.93 

36 

0.42 

0.34 

0.93 

0.99 

30 

0.4 

0.32 

0.91 

0.95 

13 

0.39 

0.31 

0.93 

0.8 

42 

0.35 

0.29 

0.92 

0.8 

44 

0.31 

0.25 

0.96 

0.94 

30 

0.3 

0.24 

0.94 

0.84 

5 

0.29 

0.23 

Table  5.2  Parameters  for  and  Results  of  the  Simulation  of  Section  5.1 
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The  other  parameter  values  for  the  simulation  are  displayed  in  Table  5.3. 


Other  Parameter  Values 


Velocity  of  Red  vessel 

vr 

variable 

Velocity  of  OH  sensor  S 

vs 

300  kts 

Velocity  of  DD  (pair) 

vd 

30  kts 

Number  of  White  vessels 

w 

variable 

y-direction  length  of  rectangle 

My 

300  NM 

x-direction  length  of  rectangle 

Mx 

Variable 

Side  of  square  of  OH  sensor  footprint 

f 

15  NM 

Mean  time  to  classify  detected  vessel 

T 

variable 

Number  of  OH  sensors 

s 

1 

Prob.  correctly  classifying  an  R 

crr 

variable 

Prob.  correctly  classifying  a  W 

t-WW 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  5.3  Parameters  for  Simulation  Environment  of  Section  5.1 

Figure  5.1  displays  the  results  of  the  two  approximations  for  the  probability  R  is 
detected  and  correctly  classified  before  it  leaves  the  domain;  (5.1.14)  and  (5.2.7).  The 
two  approximations  assume  the  sensor  following  times  have  an  exponential  distribution 
with  the  same  mean  as  the  simulation.  Apparently  the  two  approximations  give  very 
similar  results. 
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Approximations  to  the  Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  the 

Domain 


Terminating  Renewal  Process  Approximation 
Figure  5.1 

Figure  5.2  displays  the  results  of  the  two  approximations  for  the  probability  that  R  is 
detected,  correctly  classified,  and  escorted  before  it  leaves  the  domain;  (5.1.20)  and 
(5.2.10).  Once  again,  the  two  approximations  are  very  similar.  The  alternating  renewal 
process  approximation  (5.2.10)  is  easier  to  compute,  and  so  is  preferred. 
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Approximations  to  Probability  R  is  Detected,  Correctly  Classified,  and  Escorted  Before 

Leaving  Domain 


Terminating  Renewal  Process  Approximation 
Figure  5.2 

Figure  5.3  displays  the  fraction  of  simulation  replications  resulting  in  R  being 
detected  and  correctly  classified  before  leaving  the  domain  and  the  alternating  renewal 
process  approximation  (5.2.7).  The  expression  (5.2.7)  agrees  very  well  with  the 
simulation  results. 
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Alternating  Renewal  Process  Approximation 
Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  Domain 


Alternating  Renewal  Process  Approximation 
Figure  5.3 

Figure  5.4  displays  the  fraction  of  simulation  replications  resulting  in  R  being 
detected,  correctly  classified,  and  escorted  before  leaving  the  region  and  the  alternating 
renewal  process  approximation  (5.2.10).  The  expression  (5.2.10)  agrees  very  well  with 
the  simulation  results.  Note  that  approximations  (5.2.7)  and  (5.2.10)  assume  that  the 
sensor  following  times  have  an  exponential  distribution;  in  the  simulation,  the  following 
times  have  a  gamma  distribution  having  the  same  mean.  Apparently,  the  probabilities  are 
relatively  insensitive  to  the  shape  of  the  distribution  of  the  following  times.  The  figures 
corresponding  to  Figures  5.3  and  5.4  for  the  terminating  renewal  process  approximation 
are  similar. 
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Alternating  Renewal  Approximation 

Probability  R  is  Detected,  Correctly  Classified  and  Escorted  Before  Leaving  Domain 


Alternating  Renewal  Approximation 
Figure  5.4 

5.3.2.  Simulation  2 

Sato  (2005)  presents  results  from  a  simulation  experiment.  The  simulation  has  the 
following  assumptions.  There  are  a  constant  number  of  White  vessels  in  the  domain,  w. 
One  Red  vessel  enters  the  domain  at  time  0.  If  unescorted,  the  time  R  is  in  the  domain  has 
a  gamma  distribution.  The  times  until  vessel  detection  have  an  exponential  distribution. 
The  sensor’s  following  times  of  vessels  classified  as  R  are  independent  and  identically 
distributed,  having  a  gamma  distribution.  Each  time  a  vessel  is  detected  and  classified  as 
W,  the  sensor  remembers  that  information  for  an  independent  random  time  having  a 
gamma  distribution;  during  this  time,  the  vessel  is  not  subject  to  detection.  Tables  5.4a-b 
display  the  parameter  values  for  the  simulation.  Each  case  has  10,000  replications. 
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Mean  Shape 
time  to  param. 
loss  of  of  time 
vessel  to  loss 


Time  to 

Shape 

Shape 

classify- 

of  vessel 

classify 

param. 

param. 

cation 

classifi¬ 

detected 

R 

sensor 

infor- 

cation 

x-dir 

Velocity 

vessel 

Transit  following  mation 

infor¬ 

(NM) 

#  Whites 

of  R 

(min) 

C\VW 

crr 

Time 

times 

(hrs) 

mation 

400 

9 

21.6 

4.8 

0.98 

0.85 

26 

50 

2.8 

36 

381 

100 

16.9 

5.5 

0.89 

0.68 

19 

46 

3 

25 

375 

44 

28.6 

4.6 

0.81 

0.84 

6 

19 

2.9 

49 

313 

88 

30 

5.6 

0.99 

0.66 

8 

25 

3.3 

9 

388 

3 

22 

4.9 

0.94 

0.89 

30 

8 

1.6 

11 

394 

94 

19.7 

5.1 

0.89 

0.69 

44 

6 

0.6 

29 

338 

47 

29.5 

5 

0.8 

0.86 

46 

44 

1.5 

5 

306 

69 

29.1 

5.4 

0.98 

0.7 

50 

29 

0.9 

47 

331 

25 

18.3 

6.1 

0.94 

0.73 

13 

32 

0 

32 

350 

66 

19.2 

6.8 

0.84 

0.81 

22 

43 

0.4 

13 

344 

22 

26.3 

7.9 

0.87 

0.63 

12 

22 

0.5 

33 

356 

72 

24.8 

7.8 

0.94 

0.99 

23 

15 

1.9 

12 

319 

16 

17.8 

6.3 

0.92 

0.65 

40 

20 

3.9 

18 

369 

59 

20.6 

7.5 

0.83 

0.83 

37 

16 

3.8 

40 

325 

19 

27.7 

7.6 

0.88 

0.6 

39 

37 

2.6 

20 

363 

63 

23.9 

8 

0.96 

0.96 

35 

42 

2.3 

39 

300 

50 

22.5 

6 

0.9 

0.8 

28 

28 

2 

28 

200 

91 

23.4 

7.3 

0.83 

0.75 

29 

5 

1.3 

19 

225 

56 

16.4 

7.4 

0.99 

0.76 

49 

36 

1.1 

6 

288 

13 

15 

6.4 

0.81 

0.94 

47 

30 

0.8 

46 

213 

97 

23 

7.1 

0.86 

0.71 

25 

47 

2.4 

44 

206 

6 

25.3 

6.9 

0.91 

0.91 

11 

49 

3.4 

26 

294 

31 

15.9 

6.6 

0.82 

0.9 

5 

26 

3.1 

8 

269 

75 

26.7 

5.9 

0.86 

0.88 

42 

23 

4 

23 

250 

34 

25.8 

5.3 

0.96 

0.79 

33 

12 

3.6 

42 

256 

78 

18.8 

4.1 

0.93 

0.98 

43 

33 

3.5 

22 

244 

28 

20.2 

4.3 

0.85 

0.61 

32 

40 

2.1 

43 

281 

84 

27.2 

5.8 

0.88 

0.95 

15 

35 

0.1 

37 

231 

41 

24.4 

4.5 

0.97 

0.78 

18 

39 

0.3 

15 

238 

38 

21.1 

4 

0.84 

0.64 

20 

13 

1.8 

16 

Table  5.4a  Parameters  for  the  Simulation  of  Section  5.3.2 
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Shape 
Mean  param. 
time  to  of  time 
loss  of  to  loss 
vessel  of 


Time  to 

Shape 

Shape 

classifi- 

vessel 

classify 

param. 

param. 

cation  classifi- 

detected 

R 

sensor 

infor- 

cation 

x-dir 

Velocity 

vessel 

T  ransitfollowing  mation 

infor¬ 

(NM) 

#  Whites 

of  R 

(min) 

crr 

Time 

times 

(hrs) 

mation 

250 

2 

17.2 

4.4 

0.99 

0.96 

26 

50 

2.8 

36 

245 

20 

15.6 

4.8 

0.97 

0.92 

19 

46 

3 

25 

244 

9 

19.5 

4.3 

0.95 

0.96 

6 

19 

2.9 

49 

247 

1 

17.3 

4.4 

0.98 

0.97 

30 

8 

1.6 

11 

248 

19 

16.6 

4.6 

0.97 

0.92 

44 

6 

0.6 

29 

234 

9 

19.8 

4.5 

0.95 

0.97 

46 

44 

1.5 

5 

233 

5 

16.1 

5.1 

0.99 

0.93 

13 

32 

0 

32 

238 

13 

16.4 

5.4 

0.96 

0.95 

22 

43 

0.4 

13 

236 

4 

18.8 

5.9 

0.97 

0.91 

12 

22 

0.5 

33 

230 

3 

15.9 

5.1 

0.98 

0.91 

40 

20 

3.9 

18 

242 

12 

16.9 

5.8 

0.96 

0.96 

37 

16 

3.8 

40 

231 

4 

19.2 

5.8 

0.97 

0.9 

39 

37 

2.6 

20 

241 

13 

18 

6 

0.99 

0.99 

35 

42 

2.3 

39 

225 

10 

17.5 

5 

0.98 

0.95 

28 

28 

2 

28 

200 

18 

17.8 

5.6 

0.96 

0.94 

29 

5 

1.3 

19 

222 

3 

15 

5.2 

0.95 

0.98 

47 

30 

0.8 

46 

203 

19 

17.7 

5.6 

0.97 

0.93 

25 

47 

2.4 

44 

202 

1 

18.4 

5.4 

0.98 

0.98 

11 

49 

3.4 

26 

223 

6 

15.3 

5.3 

0.95 

0.98 

5 

26 

3.1 

8 

217 

15 

18.9 

4.9 

0.96 

0.97 

42 

23 

4 

23 

213 

7 

18.6 

4.6 

0.99 

0.95 

33 

12 

3.6 

42 

214 

16 

16.3 

4.1 

0.98 

0.99 

43 

33 

3.5 

22 

211 

6 

16.7 

4.1 

0.96 

0.9 

32 

40 

2.1 

43 

220 

17 

19.1 

4.9 

0.97 

0.99 

15 

35 

0.1 

37 

208 

8 

18.1 

4.3 

0.99 

0.94 

18 

39 

0.3 

15 

209 

8 

17 

4 

0.96 

0.91 

20 

13 

1.8 

16 

Table  5.4b  Parameters  for  the  Simulation  of  Section  5.3.2 

The  models  for  the  terminating  renewal  process  approximation  and  the  alternating 


renewal  process  approximation  assume  exponential  times  to  vessel  detection,  and  the 


unescorted  R  transit  time  through  the  domain  has  a  gamma  distribution;  these  are  the 


same  assumptions  as  the  simulation.  However,  unlike  the  simulation  model,  the  renewal 
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models  assume  the  sensor’s  following  times  have  an  exponential  distribution  and  there  is 
no  memory  of  previous  classifications. 

Figure  5.5  displays  the  results  of  both  approximations  for  the  probability  that  R  is 
detected  and  correctly  classified  before  it  leaves  the  domain.  The  two  approximations 
give  similar  results.  The  tenninating  renewal  process  approximation  tends  to  result  in 
somewhat  higher  probabilities  that  R  is  detected  and  correctly  classified  before  leaving 
the  domain,  than  the  alternating  renewal  process  approximation.  Figure  5.6  displays  the 
tenninating  renewal  process  approximation  and  the  simulation  results;  the  approximation 
tends  to  be  systematically  a  little  larger  than  the  simulation  results.  Figure  5.7  displays 
the  alternating  renewal  process  approximation  versus  the  simulation  results;  there  is  good 
agreement.  The  alternating  renewal  process  approximation  agrees  better  with  the 
simulation  results  and  is  numerically  more  stable  than  the  terminating  renewal  process 
approximation.  The  agreement  is  satisfying  since  the  simulation  model  is  more  complex 
than  the  alternating  renewal  process  model. 
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Fraction  of  Replications  Terminating  Renewal  Process  Approximation 


Terminating  Renewal  Process  Approximation  and  Alternating  Renewal  Porcess 

Approximation 

Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  the  Domain 


Alternating  Renewal  Process  Approximation 
Figure  5.5 


Simulation  Results  and  Terminating  Renewal  Process  Approximation 
Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  the  Domain 


Terminating  Renewal  Process  Approximation 
Figure  5.6 
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Simulation  Results  vs.  Alternating  Renewal  Process  Approximation 
Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  Domain 


Alternating  Renewal  Process  Approximation 
Figure  5.7 


5.4.  A  Spatial  Simulation 

Results  from  a  more  detailed  simulation  that  includes  representation  of  the  spatial 
movement  of  the  overhead  sensor  and  R  are  used  to  explore  the  robustness  of  the  renewal 
process  approximations.  A  description  of  the  simulation  is  as  follows. 

The  Search  Domain 

The  domain  is  rectangular:  Mx  NM  along  the  x-axis  and  My  NM  along  the  y-axis. 

The  footprint  of  the  sensor  is  a  square  with  sides  /NM.  The  region  is  tiled  with  squares 
having  sides /NM;  we  assume  both  Mx  and  My  are  multiples  of /  Label  the  upper  row, 

row  number  1  and  column  1  is  on  the  leftmost  side.  The  upper  left  grid  square  is  labeled 
(1,1);  the  rightmost  grid  square  in  row  1  is  labeled  (!,(/.) ;  Gx  =  M x  /  /  .  The  grid  square 
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in  the  lower  right  hand  comer  row  is  labeled  ( Gv ,  Gx  ) ;  Gy  =  My  /  / .  We  assume  there  are 

a  fixed  number  of  neutral  (White  (W))  vessels  in  the  domain. 

Initializing  the  Simulation 

1.  One  Red  (R)  vessel  enters  row  1  at  time  0.  The  column  it  enters  is  chosen  at 
random;  each  column  is  equally  likely  to  be  chosen.  The  R  travels  down  the 
column  at  a  constant  velocity  vr .  The  grid  square  occupied  by  R  is  computed  at 
each  time  the  overhead  sensor  enters  a  new  grid  square. 

2.  The  initial  position  of  the  overhead  sensor  S  is  chosen  randomly  from  the 

rectangle;  each  position  is  equally  likely  to  be  chosen.  The  grid  square  of  the 
initial  position  is  determined;  call  it  (y,x) .  Two  independent  trials  are  performed 

to  determine  the  direction  of  S.  The  x-direction  is  right  or  left;  the  y-direction  is 

up  or  down.  Each  x-direction  (respectively  y-direction)  has  a  probability  of  0.5  of 
being  chosen.  We  assume  a  raster  scan  sensor  path.  Assume  the  midpoint  of  the 
initial  grid  square  that  the  sensor  is  in  is  (y,x).  The  path  of  the  sensor  is  as 
follows:  if  the  sensor’s  x-direction  is  right  (respectively  left)  the  sensor  travels 
along  the  row  of  that  square  to  that  grid  square  with  the  largest,  (say  (y,GA.) ) 

(respectively  smallest,  (y,l))  x-value.  If  the  sensor’s  y-direction  is  up,  after 

reaching  the  boundary,  S  will  next  travel  to  square  (y-l,Gx),  (respectively 

(y-l,l));  it  will  next  travel  to  (_y-l,Gx-l)  (respectively  (y-1,2));  when  S 
enters  the  last  grid  square  along  row  1,  say(l,Gx) ,  it  then  travels  to  grid  square 
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(2 ,GX)  and  continues  to  (2 ,GX  -1)  and  so  on.  If  the  v-direction  is  down  and  S  is 


in  grid  square  (y,  Gx ) ,  then  it  will  next  travel  to  square  (y  + 1,  Gx ) .  The  velocity  of 
S  is  vs .  The  time  spent  in  each  grid  square  is 

Detection  of  R 

Each  time  S and  R  are  in  the  same  grid  square  there  is  a  probability  pdcrr  that  R  will 

be  detected  and  correctly  classified  as  R,  where  pd  is  the  probability  that  R  is  detected 
and  crr  is  the  probability  that  a  detected  R  is  correctly  classified  as  R. 

Number  of  White  (Neutral)  Vessels 

Let  w  be  the  mean  total  number  of  White  vessels  in  the  region.  The  mean  number  of 
White  vessels  in  each  square,  mw  ,  is  the  mean  total  number  divided  by  the  number  of 
grid  squares.  Each  time  the  sensor  enters  a  square,  a  Poisson  random  variable  having 
mean  mw  is  drawn;  the  resulting  value  is  the  number  of  White  vessels  in  that  square 
when  it  is  searched.  Each  vessel  in  the  square  takes  a  time  r  to  be  investigated.  A  White 
vessel  is  misclassified  as  an  R  with  probability  pdcwr  =  pd  (1  -cww)  .  If  a  White  vessel  is 

misclassified  as  an  R  in  grid  square  (vyt),  S  follows  it  for  a  time  (G'v  -y)/(vd  +  v),  where 

vd  is  the  velocity  of  the  DDs,  v  =  vr  =  vw  is  the  velocity  of  all  the  vessels,  and  Gy  is  the 
number  of  grid  squares  in  the  y-direction.  After  this  following  time  is  completed, 
S  proceeds  instantaneously  to  the  next  square  in  its  original  search  pattern.  The  total  time 

spent  in  the  grid  square  is  the  sum  of  the  travel  time  through  the  square,  plus  the  time 
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spent  investigating  all  vessels  in  the  square  plus  any  following  time  if  applicable.  If  R  is 
detected  and  correctly  classified,  it  will  be  escorted. 

5.4.1,  Comparing  Results  from  the  Spatial  Simulation  to  Those  of  the 
Renewal  Process  Approximations 

The  parameter  values  appear  in  Table  5.5.  Table  5.6  displays  the  results  of  the  spatial 
simulation  and  two  approximations  (5.1.14)  and  (5.2.7).  In  both  approximations,  the 
sensor’s  following  time  of  a  vessel  classified  as  Red  is  exponential  with  mean 
Myl2(vd  +  v,. ) ;  the  exponential  distribution  is  an  approximation  to  the  following  time 

distribution  in  the  simulation.  In  the  simulation,  the  time  the  R  spends  in  the  domain  is 
constant  and  equal  to  My/vr  .  In  the  approximations,  the  time  R  spends  in  the  domain  is 

assumed  to  have  a  gamma  distribution  with  mean  My/vr  and  shape  parameter  equal  to 
the  number  of  grid  squares  in  the  y-direction,  Gy . 


Velocity  of  Red  vessel 

vr 

15  kts 

Velocity  of  OH  sensor  S 

vs 

250  kts 

Velocity  of  DD  (pair) 

vd 

30  kts 

Number  of  neutral  vessels 

W 

variable 

y-direction  length  of  rectangle 

My 

200  NM 

x-direction  length  of  rectangle 

Mx 

200  NM 

Side  of  square  of  OH  sensor  footprint 

f 

25  NM 

Mean  time  to  classify  detected  vessel 

T 

2/60  hrs 

Number  of  OH  sensors 

s 

1 

Prob.  correctly  classifying  an  R 

crr 

variable 

Prob.  correctly  classifying  a  W 

^ww 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  5.5  Parameter  Values  for  Simulation  Results  Displayed  in  Table  5.6 
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#  Ws 

crr 

Spatial 

Simulation 

(1,000 

Replications) 
Fraction  of 
Replications 
Red  is  not 
Correctly 
Class. 

(std  error) 

Terminating 
Renewal 
Process 
Approx. 
Prob.  R 
is  not 
Correctly 
Class. 

Alternating 
Renewal 
Process 
Approx. 
Prob.  R  is 
not 

Correctly 

Class. 

200 

0.90 

0.90 

0.82 

(0.01) 

0.80 

0.81 

200 

0.90 

0.99 

0.54 

(0.02) 

0.51 

0.52 

200 

0.99 

0.99 

0.49 

(0.02) 

0.48 

0.49 

200 

0.999 

0.999 

0.43 

(0.01) 

0.39 

0.39 

100 

0.90 

0.90 

0.72 

(0.01) 

0.67 

0.69 

100 

0.99 

0.99 

0.39 

(0.01) 

0.35 

0.36 

100 

0.999 

0.999 

0.33 

(0.01) 

0.29 

0.29 

50 

0.90 

0.90 

0.61 

(0.02) 

0.53 

0.55 

50 

0.90 

0.99 

0.34 

(0.02) 

0.30 

0.30 

50 

0.99 

0.99 

0.30 

(0.01) 

0.27 

0.27 

50 

0.999 

0.999 

0.22 

(0.01) 

0.23 

0.23 

Table  5.6  Simulation  and  Approximation  Results 

Table  5.8  displays  simulation  and  approximation  results  for  cases  with  parameters 
displayed  in  Table  5.7. 
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Velocity  of  Red  vessel 

vr 

15  kts 

Velocity  of  OH  sensor  S 

vs 

200  kts 

Velocity  of  DD  (pair) 

vd 

30  kts 

Number  of  Ws 

w 

variable 

y-direction  length  of  rectangle 

My 

200  NM 

x-direction  length  of  rectangle 

Mx 

400  NM 

Side  of  square  of  OH  sensor  footprint 

f 

25  NM 

Mean  time  to  classify  detected  vessel 

T 

2/60  hrs 

Number  of  OH  sensors 

s 

1 

Prob.  correctly  classifying  an  R 

crr 

variable 

Prob.  correctly  classifying  a  W 

C\VW 

variable 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  5.7  Parameter  values  for  Simulation  Results  Displayed  in  Table  5.8 
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#  Ws 

crr 

^ww 

Spatial 

Simulation 

(1,000 

replications) 
Fraction  of 
Replications 
Red  is  not 
Correctly 
Class. 

(std  error) 

Terminating 
Renewal 
Process 
Approx. 
Prob. R 
is  not 
Correctly 
Class. 

Alternating 
Renewal 
Process 
Approx. 
Prob.  R  is 
not 

Correctly 

Class. 

100 

0.7 

0.99 

0.65 

(0.02) 

0.65 

0.66 

100 

0.7 

0.999 

0.58 

(0.02) 

0.63 

0.63 

50 

0.7 

0.99 

0.62 

(0.02) 

0.62 

0.62 

50 

0.7 

0.999 

0.58 

(0.02) 

0.60 

0.60 

100 

0.8 

0.99 

0.58 

(0.02) 

0.62 

0.62 

100 

0.8 

0.999 

0.56 

(0.02) 

0.59 

0.59 

50 

0.8 

0.99 

0.54 

(0.02) 

0.58 

0.58 

50 

0.8 

0.999 

0.56 

(0.02) 

0.56 

0.56 

100 

0.9 

0.9 

0.75 

(0.01) 

0.74 

0.75 

50 

0.9 

0.9 

0.65 

(0.01) 

0.65 

0.67 

Table  5.8  Simulation  and  Approximation  Results 

Figure  5.8  displays  the  simulation  results  of  Tables  5.6  and  5.8  and  the  alternating 
renewal  process  approximation  (5.2.7).  The  approximation  gives  very  useful  results. 
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Spatial  Simulation  and  Alternating  Renewal  Process  Approximation 
Probability  R  is  Escorted  Before  Leaving  Domain 
1000  Replications  of  the  Simulation 


Alternating  Renewal  Process  Approximation 
Figure  5.8 

5.5  Numerical  Examples  Using  the  Alternating  Renewal  Process  Approximation 

The  parameter  values  are  those  of  Table  5.5.  Figure  5.9  displays  the  alternating 
renewal  process  approximate  probability  that  R  is  detected  and  correctly  classified  for 
various  values  of  the  probability  of  correct  classification  and  number  of  Ws  in 
the  domain. 
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Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  Domain 
Alternating  Renewal  Process  Approximation 


▲  P(Correct  Class.  )=0. 999 

■  P(Correct  Class. )=0. 99 

■  P(Correct  Class. )=0. 95 
♦  P(Correct  Class)=  0.90 


Number  of  W  Vessels 
Figure  5.9 


Discussion:  The  probability  of  detecting  and  correctly  classifying  R  before  it  leaves 
the  domain  increases  as  the  probability  of  correctly  classifying  a  vessel  increases;  the 
increase  is  larger,  the  more  Ws  there  are  in  the  domain.  Being  able  to  decrease  the 
number  of  Ws  from  200  to  100  or  from  100  to  50  results  in  a  larger  increase  in  the 
probability  of  detecting  and  correctly  classifying  R  before  it  leaves  the  region  than 
increasing  the  probability  of  correctly  classifying  detected  vessel  from  0.90  to  0.95. 

Suppose  that  if  s  overhead  sensors  (P3s)  are  used  to  patrol  a  rectangular  domain  of 
200  NM  by  200  NM,  then  each  P3  patrols  a  domain  of  length  200/s  NM  in  the  x-direction 
and  200  NM  in  the  y-direction.  Other  CONOPS  are  possible.  If  there  are  w  Ws  in  the 

X 

large  domain,  then  we  assume  there  are  — —  w  Ws  in  a  domain  of  size  x  NM  in  the 

200 

x-direction  by  200  NM  in  the  y-direction.  Assume  1  R  enters  the  domain  at  time  0  and 
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travels  straight  down  the  domain  in  the  y-direction.  The  time  the  unescorted  R  spends  in 
the  domain  has  a  gamma  distribution  with  mean  200 lvr  and  shape  parameter  200/  /. 
Thus,  the  R  will  be  in  the  domain  patrolled  by  one  sensor.  All  of  the  sensors  can 
misclassify  Ws  as  R.  We  assume  there  are  a  sufficient  number  of  escort  vessels  to  escort 
all  the  vessels  classified  as  R.  Table  5.9  displays  the  parameter  values.  Figure  5.10 
displays  the  alternating  renewal  process  approximation  for  the  probability  that  R  is 
detected  and  correctly  classified  as  a  function  of  the  x-distance  of  the  rectangular  domain 
patrolled  by  one  sensor  and  the  number  of  Ws  in  the  total  domain  of  size  200  NM  by 
200  NM,  w. 


Velocity  of  Red  vessel 

A 

15  kts 

Velocity  of  OH  sensor  S 

A 

250  kts 

Velocity  of  DD  (pair) 

vd 

30  kts 

Number  of  neutral  vessels 

w 

variable 

y-direction  length  of  rectangle 

My 

200  NM 

x-direction  length  of  rectangle 

Mx 

variable 

Side  of  square  of  OH  sensor  footprint 

f 

10  NM 

Mean  time  to  classify  detected  vessel 

T 

2/60  hrs 

Number  of  OH  sensors 

s 

1 

Prob.  correctly  classifying  an  R 

crr 

0.99 

Prob.  correctly  classifying  a  W 

^ww 

0.99 

Prob.  a  vessel  in  the  footprint  of  the  OH  sensor  is  detected 

Pd 

1 

Table  5.9  Parameter  Values  for  Figure  5.10 
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Probability  R  is  Detected  and  Correctly  Classified  Before  Leaving  Region 
Distance  of  y-Direction  of  Domain  =200  NM 
#  Ws  in  Domain=(x/200)w 
Alternating  Renewal  Process  Approximation 


-w=25 
-  w=50 
-w=100 


Discussion:  In  order  to  have  an  approximate  probability  of  detecting  and  correctly 
classifying  R  before  it  leaves  the  region  of  about  0.9,  four  overhead  sensors  are  needed. 
Each  sensor  patrols  a  rectangular  domain  50  NM  by  200  NM.  For  the  parameter  values 
considered,  the  approximate  probability  of  detecting  and  correctly  classifying  R  before  it 
leaves  the  region  is  more  sensitive  to  the  size  of  the  domain  the  sensor  patrols  than  the 
number  of  Ws  in  the  domain;  however,  the  number  of  Ws  considered  are  25,  50,  and  100. 


Decreasing  the  size  of  the  domain  that  a  single  sensor  patrols  also  decreases  the  number 
of  Ws  in  the  domain  and  hence  the  false  positive  rate. 

6.  Assessing  the  Performance  of  the  Automatic  Identification  System  (AIS)  for 
Vessel  Tracking 

The  Automatic  Identification  System  (AIS)  is  a  communication  system  using  two 
frequencies  in  the  VHS  maritime  band  by  vessels  to  periodically  broadcast  information 
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about  position,  identification,  etc.  The  rate  at  which  a  vessel  transmits  its  information 
depends  on  the  speed  of  the  vessel  and  how  it  is  maneuvering.  Each  vessel  broadcasts  its 
information  to  vessels  within  its  line  of  sight.  At  most,  4,500  messages  can  be  transmitted 
per  minute  when  each  message  takes  one  time  slot.  A  self-organizing  time  division 
multiple  access  (SOTDMA)  protocol  is  used  to  minimize  the  chance  that  two  messages 
from  different  vessels  will  use  the  same  time  slot.  The  international  maritime 
organization  and  governments  are  requiring  vessels  of  certain  sizes  to  use  the  AIS 
system.  It  is  hoped  that  AIS  will  decrease  the  number  of  vessel  collisions  and  increase 
maritime  safety  and  security.  There  is  also  interest  in  using  the  AIS  messages  to  track 
vessels.  There  are  land  AIS  receivers  and  there  is  a  proposal  to  put  AIS  receivers  on 
satellites.  A  receiver  on  a  satellite  may  have  a  field  of  view  that  extends  over  a  domain  in 
which  vessels  do  not  have  line  of  sight  with  each  other.  In  this  case  vessels  may  be  using 
the  same  time  slots  to  transmit  messages;  in  which  case,  all  messages  using  the  same  time 
slot  will  not  be  received  by  a  satellite  receiver. 

6.1.  Formulation  of  a  Continuous  Time  Markov  Chain  Model 

Each  vessel  is  in  one  of  J  subdomains.  Assume  a  vessel  uses  a  time  slot  for  an 
independent  random  time  having  an  exponential  distribution  with  mean  \trj ;  it  then 
chooses  a  new  time  slot  that  is  not  being  used  by  another  vessel  in  its  own  subdomain, 
assuming  one  exists.  Each  vessel  must  use  s  different  time  slots  each  minute.  Let  c  be  the 
total  number  of  time  slots  available.  Let  bj  be  the  number  of  vessels  in  subdomain 

J 

=  here  c>bjs.  Let  b='Ybj  be  the  total  number  of  vessels  in  all 

7=1 

the  subdomains. 
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Consider  a  particular  time  slot.  Let  X  j  (?)  be  equal  to  1  if  the  time  slot  is  being  used 


at  time  t  by  a  vessel  in  subdomain  j  and  0  otherwise. 


PyXj  (?  +  /;)  =  1 1  Xj  (?)  =  Oj  =  rjbjS  x - — h  +  o(h ) 

rate  » _ v.._ L 

at  prob. 

which  choose 

vessels  a 

in  particular 

region  idle 

j  time  slot 

change 

time  slots; 

each  vessel 

uses 

s  time 

slots 


p{Xj  (?  +  /?)  =  0|  Xj  (?)  =  l|  =  rjh  +  o(h ) 


(6.1.1) 


Thus,  the  long  run  proportion  of  time  one  time  slot  is  busy  with  a  vessel  from 


subdomain  j  is  nj  =  bjs/c  .  The  long  run  proportion  of  time  one  particular  time  slot  is  not 


being  used  by  any  vessel  in  any  sub-domain  is  J  ] 


7=1 


1-- 


b.s 


Let  X(t)=  Xx(t),...,X j(?)]  a  vector  indicating  those  subdomains  that  have  a  vessel 


using  the  particular  time  slot.  Let  1  be  a  J-dimensional  row  vector  that  has  a  1  in  the  j 


th 


column  and  zeros  elsewhere.  Since  the  subdomains  are  independent 


n 


(x)  =  lim  P^X  (?)  =  x}  =  Pj 

7=1 


t— >00 


bjCl 


1- 


bjCl 


“ini — x : 


(6.1.2) 


The  long  run  proportion  of  time  a  time  slot  has  exactly  one  vessel  using  it  is 

J 


2>h)=z^n 


7=1 


7=1  k*j 


1- 


b^a 


(6.1.3) 


Consider  a  vessel  in  subdomain  d.  It  uses  s  time  slots  during  a  minute.  Let  the 

probability  that  all  messages  from  the  vessel  are  blocked  during  a  minute  be 
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\S 


Yd{s)  = 

i-n 

1- 

'vl 

r» 

j^d 

- 

yr 

prob 

no  other 
subdomain 
using 
time 
slot 


(6.1.4) 


6.2  Numerical  Example 

There  are  2,250  time  slots  on  each  of  two  frequencies.  There  are  c=4,500  time  slots  in 
total.  Assume  each  vessel  transmits  at  s=6  times  per  minute.  Each  message  requires  one 
time  slot.  Suppose  there  are  J=20  subdomains  and  each  subdomain  contains  the  same 
number  of  vessels.  A  satellite  will  be  able  to  receive  a  message  from  a  vessel  in  its  field 
of  view  if  a  vessel  transmits  the  message  in  a  time  slot  that  is  not  blocked  by  vessels  in 
other  subdomains  during  the  observation  time,  Tobs ,  of  the  satellite.  We  say  that  a  vessel 
is  observable  if  at  least  one  time  slot  that  the  vessel  uses  during  an  accessible  observation 
time  is  not  blocked.  Let  the  probability  that  a  vessel  in  subdomain  d  is  detected  be 

Pd(s’Tobs)  =  ]-rd(s)T°bs  ■  (6-2.1) 

If  all  subdomains  contain  the  same  number  of  vessels,  then  (6.2.1)  is  equal  to 
expression  (3.2)  in  Ericksen  et  al.  (2004).  Ericksen  et  al.  (2004)  report  that  this  simple 
formula  agrees  well  with  results  from  a  more  detailed  simulation  of  the  probability  that  a 
vessel  will  be  detected. 
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Figure  6.1  displays  the  probability  of  vessel  detection  as  a  function  of  the  total 
number  of  vessels  in  all  the  subdomains.  The  numbers  of  vessels  in  each  subdomain  are 
assumed  to  be  equal.  The  observation  time,  Tobs  =15  minutes. 

Probability  Detect  Vessel  During  Observation  Time 
(at  least  one  time  slot  is  not  blocked) 

Each  Vessel  Transmits  6  Times  per  Minute 
15  Minute  Observation  Time 


7.  Conclusions 

We  have  presented  models  and  results  for  a  maritime  domain  awareness  scenario.  In 

the  scenario,  there  are  neutral  vessels,  Whites  (W),  and  hostile  vessels,  Reds  (R), 

traveling  within  a  domain.  A  patrolling  overhead  sensor  detects  vessels  in  the  domain  and 

classifies  them  as  W  or  R.  The  overhead  sensor  follows  each  vessel  that  is  classified 

(perhaps  incorrectly)  as  R  until  relieved  by  escorting  vessels;  during  this  time  it  is 

unavailable  to  detect  additional  vessels.  The  ability  to  detect,  correctly  classify,  and 

escort  Rs  is  influenced  by  the  size  of  the  domain,  the  number  of  Ws  that  are  in  the 

domain,  and  the  probability  of  correctly  classifying  detected  vessels.  The  introduction  of 
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technology  such  as  the  Automatic  Information  System  (AIS)  to  track  vessels  should 
decrease  the  number  of  Ws  in  the  domain  and  thus  increase  the  ability  to  neutralize  Rs. 
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Appendix  A:  An  Exponential  Model  for  the  Probability  that  a  Red  Vessel  will  Leak 

Through  a  Maritime  Domain 

A.l.  The  Probability  of  Detecting,  Classifying,  and  Escorting  a  Red  Vessel 

Assume  there  are  always  w  White  vessels  (Ws)  in  the  domain  and  there  are  no 
Red  (R)  vessels.  The  time  until  an  overhead  sensor  (OH)  detects  a  white  vessel  has  an 
exponential  distribution  with  mean  1 I  S(w) .  Each  time  the  OH  detects  a  W  it  classifies  it 

as  a  W  with  probability  c w  .  With  probability  cwr  it  misclassifies  W  as  an  R.  All  vessels 
that  are  classified  as  R  are  tracked  (followed)  for  a  time  having  an  exponential 
distribution  with  mean  1  /  </> .  During  the  following  time  no  further  vessels  are  detected. 
The  time  until  detection  of  a  W  that  is  classified  as  R  has  an  exponential  distribution  with 
mean  l/[<5(w)cw]. 

Assume  a  Red  vessel  (R)  enters  the  domain  at  time  0.  The  R  will  remain  in  the 
domain  for  a  time  having  an  exponential  distribution  having  mean  1 1  ju .  The  time  until 
the  R  is  detected  has  an  exponential  distribution  with  mean  (w+\)l  S(w+\)  if  the  OH  is 
searching  and  there  are  w  Ws  in  the  domain.  When  the  R  is  detected,  it  is  correctly 
classified  as  R  with  probability  crr .  The  time  until  the  Red  is  detected  and  correctly 

classified  has  an  exponential  distribution  with  mean  ( w  +  l)/[<5(w  +  l)crr]. 

We  assume  all  exponential  times  are  independent.  Let  p(w)  be  the  probability  that 

the  Red  is  detected,  correctly  classified,  and  escorted  before  it  leaves  the  domain  given 
there  are  w  Ws  in  the  domain. 
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S(w+ 1) - crr 

p(»-)= - ,  "•+'  - - 

S[w+  l)  -  Cyy  +  C)(w+l)  -  Cu,y  +  U 

L  V  ’w  + 1  V  ’w  + 1  w' 


Prob.  Red 
is  detected 
and  correctly 
class,  before 
Red  leaves 
region  or 
a  W  is  misclass. 


£(w  +  l)  — -cwr 

_ w  + 1 _ 

5(w  +  \)-^—crr+5(w  +  \)^—Cwr+  /LI 
w  + 1  w  +  1 

Prob. 

W  is  misclass. 
before  Red 
is  detected 
and  correctly 
class,  or  Red 
leaves 
region 


(A.  1.1) 


Solving 


p(w)=- 


S(w  + 1) - cr 

v  ’w  + 1  ' 


S(w  +  \) - -crr  +  £(w  +  l)— cwr  +ju  ^  + 

w+1  w+1 


S(w  + 1)— — i 
V  ;w  +  l 


<j(w  +  l)  ^—Cyy  +<5’(w  +  l)  — —  Cwr  +  /J 
W  +  1  W  +  1 


(A.  1.2) 


S(w  + 1) - crr - 

= _ V  'w  +  1  </>  +  jU _ 

S(w+\)^—crr+S(w+\)^-cwr-^—  +  iLi 
W+1  W+1  <p  +  fi 

Let  p0  (w)  be  the  probability  the  Red  is  detected  and  correctly  classified  before  it 


leaves  the  domain. 
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A.2.  Misclassified  White  Vessels  are  Removed  from  the  Population 

Assume  that  each  time  a  White  vessel  is  classified  as  R,  it  is  removed  from  the 
population.  The  above  equations  become  systems  of  equations.  For  example,  the 
conditional  probability  that  Red  is  escorted  before  it  leaves  the  domain  given  there  are  w 
Whites  in  the  domain  satisfies  the  equation 
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S(w  + 1) - crr  , 

pH-  - - *- 

S(w  + 1) - crr+S(w  + 1)  W  cwr  +  ju  ^  +  ^ 

L  W  +  1  W  +  1  J  .  (A. 2.1) 

S(w  +  l)^—Cwr  1  A 

+  - - - ^±1 - - - *—p(w-  1) 

J(w  +  1) - -c;r  +  <?(w+l)— cw.  +//  ^  +  fU 

w  + 1  w  +  1 

The  conditional  probability  that  Red  is  detected  and  correctly  classified  before  it 
passes  through  the  domain  given  there  are  w  Ws  in  the  domain  is 


S(w  + 1) - crr 

P()iw)=  - y - — — - 

J(w  +  1) - -crr  +  5{w+ 1) - -  cwr+ju 

w  +  1  w  +  1 

S(w  + 1)  W  cwr  , 

+  - - - - - — Po{w-l) 

J(w  +  1) - -crr  +  S(w  +  l)— —Cw.  +  ju  0  +  /J 

w+1  w+1 


(A. 2.2) 
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Appendix  B:  A  Recursive  Procedure  to  Find  Limiting  Probabilities  for  a  Truncated 
Finite  State  Space  Quasi-Birth  and  -Death  Model 

Assume  Reds  that  arrive  when  there  are  N  Rs  in  the  domain  are  lost  and  do  not  enter 
the  domain.  The  state  space  is  ( n,s),(n,f),(n,c )  for  n  =  0,..., N;  see  Section  (3.1). 

The  balance  equations  for  states  (N,s),  (N,f),  and  (N,c)  are: 

[iV[//  +  £0]  +  N,s)  =  AyTT^N  -  l,s)  +  (j>niy  N,f)  +  </>7r(  N,c) 

[NjU  +  </>]7r(N,f)  =  Arx(N-l,f)  +  Swn(N,s) 

[iV//  +  ^]/r(jV,c)  =  -1,c)  . 

An  outline  of  the  recursive  procedure  to  find  the  limiting  distribution  is  as  follows; 
see  also  Gaver  et  al  (1984).  For  each  number  of  Rs  «>0. 

1.  Use  the  balance  equation  for  (77,/)  to  express 

n(n,f )  =  Bt  (/7,s);r(/z,s)  +  BT  (/7,/)/r(77  - 1,/)  +  BT  (/7,c)/t(t7,c) 

2.  Use  the  balance  equation  for  (77, c)  to  express 

;r(/7,c)  =  Cj  ( n,s)7v{n,s )  +  CT  («,/) n(n  -1,/)  +  CT  ( n,c)7r(n  -  l,c) 

3.  Use  the  balance  equation  for  (n,s)  to  express 

7r(n,s)  =  A[n,s)rc{n  -l,s)  +  A(n,f)/r(n  -1,/)  +  A(n,c)x(n  -l,c) 

4.  Use  2  and  3  to  express 

;r(/7,c)  =  C(n,s)7r{n  - 1,5)  +  C (77,/) ^(77  - 1,/)  +  C(n,c)n(n  - 1  ,c) 

5.  Use  1,3,  and  4  to  express 

n (77, /)  =  5(77, s) rt  (77  - 1, 5)  +  B (77, /) n (n  - 1, /)  +  B (77, c) n (77  -  l,c) 
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6.  Use  the  balance  equation  for  (0,/)  to  express 
/r(0,/)  =  5(0,s)/r(0,s)  +  f?(0,c)/r(0,c) 

7.  Use  the  balance  equation  for  (0,c)  to  express 
;r(0  ,c)  =  C(0,s,)^(0,s') 

8.  Find  /r(0,.s)  so  that  the  sum  of  the  limiting  probabilities  equals  1. 

Detailed  Calculations  appear  below. 

Balance  equation  for  (N,f): 


n 


(*•/)  = 


/L 


N/j  +  (f> 


N/u  +  (p 


-n 


(M 


Let  Bt  [N,f)  ■ 


X,, 


D(N,f ) 


D{NJ) 


;jD(7V,/)  =  7V/y  +  ^ 


n(N,f)  =  BT(NJ)n(N-\,f)  +  BT(N,s)n(N,s). 
Balance  equation  for  (N,c): 

n(N,c)  =  Cj’(N,c)x(N -l,c) , 

where 


Ct{N,c)  = 


X,, 


Nju  +  (j) 


Balance  equation  for  (N,s): 


[jV[//  +  £>0  +<7w  k(N,s)  =  -\,s)  +  0 


Nju  +  0 


NjU  +  </> 


+<j)CT  (iV,c)/r(jV-l,c) 

=  ^(JV-l,s)  +  ^[5r(iV,/)^(iV-l,/)  +  5r(iV,s)^(iV,s)]  +  ^Cr(iV,c)^(iV-l,c) 


Let 


D(Ahs)  =  [Af[//  +  £0]  +  £w-^8j(iV,s)] 
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n 


Ay 


7r(N -l,s)  +  </>  7r{N- !,/)  +  </> Cj}^C} n{N-\,c) 


^N^~D{N,sY^  **“'  '  r  D(N,s)  "v"  D(N,s ) 

=  A(N,s)k(N -\,s)  +  A(NJ)k(N -\,f)  +  A(N,c)tt(N -\,c) 


x(N,f)  =  BT(N,f)x(N-\,f)  +  BT(N,s)x(N,s) 

=  BT(N,f)x(N-l,f)  +  BT(N,s)\_A(N,s)x(N-l,s)  +  A(N,f)x(N-l,f)  +  A(N,c)x(N-l,c)j, 
=  B(N,s)tt(N -\,s)  +  B(NJ)k(N -\,f)  +  B(N,c)k(N -\,c) 


where 


B(N,s)  =  BT(N,s)A(N,Sy,B(N,f)  =  BT(N,f)  +  BT  (N,s)A(N,f); 
B(N,c)  =  Bt(N,s)A(N,c ) 

For  l<j<N 

x{j,f) 

=  B(j,s)7r{j -1,5)  +  B(j,f)7t(j -1,/)  +  B(j,c)a(j -\,c), 
where 

B {j,s)  =  Bt  (j,s)  A(j,s)  +  Bt  (j, c )  C (j,s) 

B(j,f)  =  BT(j,f)  +  BT(j,s)A(j,f)  +  BT(j,c)C(j,f) 

B(j,c)  =  BT(j,s)A(j,c)  +  BT(j,c)C(j,c). 

x{j,c) 

=  C(j,s)7r(j-l,s)  +  C(j,f)7r(j-l,f)  +  C(j,c)x(j-\,c), 
where 

C(j,s)  =  CT(j,s)A(j,s) 

C{j,f)  =  CT(j,s)A(j,f)  +  CT(j,f) 

C(j,c)  =  CT  ( j,s)A(j,c )  +  CT  ( j,c ). 
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x(j,s) 

=  A(j,s)n(j-\,s)  +  A(j,f)7r(j-\,f)  +  A(j,c)7r(j-\,f), 
where 


A(j’s) 


AW 


Ar 

D(j,s ) 

\j> +  {j  +  + 1  >/)][-%  U’f)  +  bt  (J’c)Ct  U’f)\ 

D(j,s) 


\j>+{j +i)//^(y +1jc)]c,7’  (7,/) 
D(j,s) 


A(j,c) 


\j>  +  (7  + 1)^(7  +  !>/)_  Bt  {J’c)Ct  0’c) 

D(j,s) 


[t  +  {j  +  l)M(j  +  l,c)~\CT(j,c) 

D{j,s) 

[7  [7/  +  ^0]  +  ^w  +/^r]“[^  +  (7  + 1)^(7  +  !)/)] [^r  (j’s)  +  Bt  (7 hc)CT  (7,5)] 
-[^  +  (y  +  l)//^(y  +  l,c)]Cr(y>)-(y  +  l)//^(j  +  l,^). 


£>(7, 7r)  =  [y>  +  ^  +  4-  -  (7  +  (7  +  1, /)] 


*u’f)=DUjr 

( (  +  l)//«(/  +  U) 


0-i./)+ 


-+ 


(7  +  1)^(7  +  !^) 


Z7(y,/)  £>(7,/) 


'(7» 
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U>c) 


DU’f) 

=  (7,  /)  ^  (7  - 1,  /)  +  5r  (y>)  ^  (7,  5)  +  Bt  ( j ,  c )  7r  (7,  c) 


^(y'.c)  =  [y>  +  </>  +  Ar  -  (7  + 1)4+1  (7  +  l,c)] 

~{j  + 1) BoA(j  +  hf)BT  ( j,c )  -  (7  +  1)//Cr  (7  + 1  ,c) 


Tt 


+ 


(7  +  1)4  +4  (7  +  1,5)  +  A(j  +  \,f)BT(j,s)~  +(7  +  1)//[C(7  +  1,5)  +  C(7  +  1,/)7?j(7,5)] 


|  (7  + 1) 4^(7  + 1, /)■%  (7, /)  +  (7  + 1) MC{j  +  1,  f ) bt  (j, /)  _  /  .  -x 

77(7,0)  /TL/‘ 


s  cr  (y. /)  *  (7  - 1,  /)  +  CT  (7,  s)  n  (7,  s)  +  CT  (7,  c)  n  (7  - 1,  c) 


x(j,s) 
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Finally,  the  balance  equation  for  j=  1  is 


[n  +  \  +  =  Ar7t{0,f)  +  8w7t(\,s)  +  2nn{2,f) 

-  /l^(0,/)  +  Sw7i(\,s)  +  2fu\J}(2,s)7r(\,s)  + +  5(2,c);r(l,c)] 


Let 


D(l, /)  =  [//  +  ^+^-2^5(2,/)] 
si’(l./)  =  7jr7T;sr(l.s)  =  -<?’'  +  2/,'8<2’S) 


«r(U)  = 


0(1,/) 
2/jB{2,c ) 

^(U) 


^■(l,/)  =  5r(l, 5)^(1, s)  +  BT{\,f)7t{Q,f)  +  Bt{\,c)k{\,c) . 

The  balance  equation  for  /r(l,c)  is 

[Tr  +  //  +  ^]/r(l,c)  =  2///r(2,c)  +  /l7./r(0,c)  +  2c>o^'(2,s) 

[Tr  +  //  +  ^]/r(l,c)  =  2//[C(2,s);r(l,s')  +  C(2,/);z-(l,/)  +  C(2,c);r(l,c)]  +  /t,.;r(0,c) 
+2J0  [v4(2,j)  ^(1,5)4-  v4(2,/)/r(l,/)  +  v4(2,c)/r(l,c)] 

[T,.  +  //  +  ^]/r(l,c)  =  2//[c(2,s)/r(l,s)  +  C(2,c)^(l,c)]  +  /l,./r(0,c) 

+2J0  [v4(2,j)^(l,j)  +  J(2,/)/r(l,/)  +  v4(2,c)/r(l,c)] 

+2//C(2,/)[f?r(l,s)^(l,S)  +  5r(l,/)^(0,/)  +  5r(l,c)^(l,c)] 

=  2//[c(2,  j)^(1,j)  +  C(2,c);r(l,c)]  +  /l7.^’(0,c) 

+2J0  [^4(2, 5)^(1, s)  +  v4(2,c)/r(l,c)] 

+2J0  ^(2,/)[5r(l,  s)/r(l,  s)  +  5r(l,/)^(0,/)  +  5r(l,c)^(l,c)] 
+2iiC{2,f)[BT{\,s)K{\,s)  +  BT{\,f)jz{0,f)  +  BT{\,c)7r{\,c)] 


D{\,c)  =  [Ay  +  fi  +  </)\  —  2juC(2,c)  —  2SqA(2,c)  -  2juC(2,f)BT  (l,c) 
-2J0^(2, /)5r(l,c) 

*(l,c)  =  Cj  (1, s)n(\, s)  +  CT  (1  ,/>(0,/)  +  Cj  (l,c)/r(0,c) , 
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where 


cy(u) 


CT(hf) 


CT{l,c) 


2juC(2,s)  +  2S0A(2,s)  +  2S0A(2,f)BT(\,s)  +  2juC(2,f)BT(\,s) 

0(1, c) 

2S0A(2,f)BT  (l,/)  +  2/iC{2,f)BT  (l  j) 

0(1,  c) 

Ay 

0(1, c) 


The  balance  equation  for  /r(l ,s) 


[//  +  c>0  +  2,.  +5M;];r(l,j)  =  ^r^'(0,s)  +  ^(l,/)  +  ^(l,c)  +  2)u^,(2,j) 

=  A^(0,j)  +  ^[5r(l,j)^(l,j)  +  5r(l,/)^(0,/)] 

+^[l  +  5y  (l,c)][Cj  (l,5)^(l,s)  +  Cj  (l,/)^(0,/)  +  Cj  (l,s)/r(0,c)] 
+2//[j(2,5)^(l,s)] 

+2^(2,/)[5r(l,j)^(l,j)  +  5r(l,/)^(0,/)] 

+2iiA(2,f)BT  (l,c)[Cr  (l,s)/r(l,s)  +  Cr  (l,/>(0,/)  +  CT  (l,c);r(0,c)] 
+2/iA{2,c)[Ct  (1, s)n(\, s)  +  CT  (l,/>(0,/)  +  CT  (l,c);r(0,c)] 


D(\,s}  —  n  +  5q  +  Ay  +  5W  -cj)BT  (1,5)  -^[l  +  Bj  (l,c)JCj  (1,5) 

-2fuA{2,s)-2/uA{2,f)BT{l,s) 

-2]uA(2,f)BT(\,c)CT{\,s)-2luA(2,c)CT{\,s) 


Then 

/r(l,s)  =  A(1,s)tt(0,s)  +  A(l,f)n(0,f)  +  A(l,c)n(0,c) , 
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where 


4(1,5) 


Ar 

0(1,. s') 


A^f) 


</>BT(\,f)  +  </>[\  +  BT(\,c)]CT{\,f)  +  2MA(2,f)BT{\,f) 

0(1,5) 


2 HA (2, /) 5r  (1, c) Cj  (1, /)  +  2//4(2, c ) Cr  (l, /) 
+  0(1,5) 


^4(1,  c) 


^[l  +  Bt  (1  ,c)]CT  (l,c)  +  2juA(2,f)BT  (1  ,c)CT  (l,c)  +  2//4(2,c)Cr  (l,c) 

0(1,5) 


*(l,c)  =  Cr  (1, 5)^(1, 5)  +  CT  (l,/>(0,/)  +  Cj  (l,c)/r(0,c) 

=  Cr(l,5)[4(l,5)^(0,5)  +  4(l,/)^(0,/)  +  4(l,c)^(0,c)]  . 
+Cr(l,/);r(0,/)  +  Cr(l,c)/r(0,c) 

^•(l,c)  =  C(l,5)^(0,5)  +  C(l,/)^(0,/)  +  C(l,c)^(0,c), 
where 

C(l,5)  =  cy(l,5)4(l,5) 

C(l,  /)  =  Cr(l,  5)4(1,  f)  +  CT(\,f) 

C(l,c)  =  CT  (1, 5)4(1, c)  +  CT  (l,c). 

;r(l,/)  =  5r(l,5);r(l,5)  +  5r(l,/);r(0,/)  +  5r(l,c);r(l,c) 

-  Bt  (l,5) [4 (1,5)  ^(0,5)  +  4(l,/);r(0,/)  +  4(l,c);r(0,c)] 

+Bt{\, />(0,/)  +  5r(l,c)[c(l,  5)^(0, 5)  +  C(l,/)/r(0,/)  +  C(l,c)/r(0,c)] 

=  5(l,5);r(0,5)  +  5(l,/)/z’(0,/)  +  5(l,c);r(0,c), 

where 

5(l,5)  =  5r(l,5)4(l,5)  +  5r(l,C)C(l,5) 

5(l,/)  =  5r(l, 5)4(1, /)  +  5r(l,/)  +  5r(l,c)C(l,/) 

5(1,  c)  =  5r(l,  5)4(1,  c)  +  Bt(\,c)C(\,c). 

The  balance  equation  for  /z-(0,/ ) 

[2,.  +^]^(0,/)  =  5w^(0,5)  +  //^(l,/) 

=  4w,^(0,5)  +  /y[5(l,5)^(0,5)  +  5(l,/)^(0,/)  +  5(l,c)^(0,c)] 
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Let 


D(O,f)  =  A,  +  0  —  /jB(l,f) 


=  B(0,  s)/r(0,  s)  +  B(0,  c);r(0,c) 


The  balance  equation  for  /r(0,c) 

(A,.  +0)x(O,c)  =  jUx(l,c)  +  5q7:(\,c) 

=  //[c(1,s)^(0,s)  +  C(1,/)^(0,/)  +  C(1,c)^(0,c)] 

+5q[_A(\,s)x(0,s)  +  A(\,f)x(0,f)  +  A(\,c)n(0,c)~\ 

=  //C(l,/)[5(0, s)/r(0,  s)  +  5(0,  c)^(0,c)]  +  //[C(l,s)^(0,s)  +  C(l,c)^(0,c)] 
+<5'o^(h/)[-#(0>s,)^(0>s,)  +  f?(0,c)/r(0,c)]  +  S0  [j(l,s);r(0,s)  +  J(l,c);r(0,c)] 


Let 


Z?(0,c)  =  ^.+^-^[C(l,c)  +  C(l,/)5(0,c)]-^[^(l,c)  +  ^(l,/)5(0,c)]. 
Then 


^■(0,c)  =  C(0,s);r(0,s), 
where 


C(0,s) 


//[C(l^)  +  C(l,/)g(0,5)]  +  ^o[^(l^)  +  ^(l,/)g(0,5)] 

D(0,c) 


/t(0,.v)  is  found  using  the  fact  that  the  limiting  probabilities  sum  to  1. 
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